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Executive Summary 



Many ecdnomically disadvantaged youths^ because they lack the skills 
to find and hold a job, face long-term emplbjnnent problems. The Con- 
gress aefattowledged this when it enacted the Job Training Partnership 
Act— the primary federal job training program fbr economically disad- 
vantaged youths and adults. Since its inception in 1983, about $1.9 bil- 
lion has been appropriated annually for title II-A of the act, and at least 
40 percent of the funds are supposed to be spent oh services for youth. 
Because the act stresses performance, it also provides funds for incen- 
tive awards for good performance. While job placement is the primary 
performance measure for adult pf dgrains, the act specifies that youth 
programs should also measure other factors, such as attainment of 
"emplbjnrnent ebmpeteheies" needed for success in the labor market. The 
procedures local programs use to provide training in such competencies 
constitute their "competency systems." 

Local programs have had wide dtsa etion in defining employment com- 
petencies and in designing and operating competency systems, and little 
has been known at the national level about just what they have been 
doing and what it means when they say a youth has attained cbmpe- 
tehcies." In this report, gag discusses the (1) extent and nature of youth 
eompeteney systems ^ of June 30, 1985, and (2) competency attainment 
data reported to states forjudging local program performance. 



Background Gohipeteney-based training cOTisists of definmg the skills to be learned, 

^ determining the sldlls the learner already has, providing training in the 

deficient skills, and evaluating whether the learner attained the desired 
sldlls. The Department of Labor has grouped employment competencies 
into three major areas. They are (1) pre-employment and work maturity 
sldlls needed to find and hold a job, (2) basic education sldlls, and (3) job 
skills for specific occupations. 

To evaluate local performance, states use national standards set by 
Labor. The5' can, however, acUust the stsmdards for locsd factore, such 
as client characteristics and services provided. Local programs report 
performance data to the state and to Labor, using the Job Training Part- 
nefship Act Annual Status Report. 

GAO's review ihcluded inter-views with Labor and Office of Management 
and Budget (omb) officials, questionnaires sent to all 582 local programs 
in the states and District of Columbia, detailed questionnaires sent to a 
random sample of 100 programs in 32 states, and visits to 8 locations. 
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Results in Brief ^^^^ programs have some youth competency sj^tem, but they 

differ si^fic^tjy in the competency areas included and in criteria for 
youths to be reported as a program success due to attainment of compe- 
tencies. iSince competency progranis are locally determined and can vary 
substantially, states need performance standm-ds that are a^usted to 
account for differences in competency systems. Otherwise, less compre- 
h^ive programs, such as those providing only pre-emjploymeht skills 
training, will appear more successful than those providing training that 
includes basic education, which is more costly and harder for trainees to 
complete. Thus, incentive awards could discourage, not encourage, pro- 
vision of the trmning many youths need. 

As there are both advantages and disadvantages to a separate compe- 
tency f^erfdrmance standard, gaO takes no position on whether one 
should be set. But if a competency standard is established, gag believes 
it should measure 

employability of youth— which requires data on the extent to which all 
youth in cpmpetency training attained cbmpeteheies^ GNffi^ however, dis- 
approved Labor's request to begin collecting that data in program year 
1986 so that such a standard could be set for program year 1988. gao 
believes these data are needed for a competency standard. 



Principal Findings 



Competency Areas Differed Of the almost 600 local job training progrmns, 91 percent reported to 

GAO that they had implemented or were developing competency systems 
in Jtme 1985. llie diversity of such systems was described in responses 
to the more detailed questionnaire GAO sent to 100 programs. Gf the 87 
programs responding, 37 said they provided training in only one compe- 
tency area (and that area was preHemployrnent/work maturity for 34 of 
the 37); 28 had two competency areas; and 22 included all three. 

The diversity in mjEypr areas of training is significant because of the dif- 
ferences in training time. In the eight loeatiora gao visited, for example, 
the maximum time spent oh pre-employment training generally was less 
th^ 50 houre, while basic education and job-specific training typically 
required several hundred hours. 
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''Attainment** Criteria Griteria for reporttag "successfui" terminations of youth participants 

Differed attainment of competencies also differed among local prt> 

grams. For example, some programs that offered training in more thaii 
one competency area required that a youth attain only pre-employment 
competencies, while others required attainment in basic education or 
job-specific skills as well. Criteria for reporting success in an^'- one rapjor 
area also differed. For example, one program required that a youth 
attain 22 of 24 identified pre-emplc^aneht cbmE)etehcy skills (which took 
about 40-48 hours of training) to be reported to the state as a prograrrt 
success. Another progrmn, however, required att^nment of only 1 of 15 
pre-employment sIdUs (which took 3 or 4 hours). 



Data for Competency Currently, perfomance standards for youth combine attainment of 

Standard tacking employrnent competencies with other positive outcomes, but Labor has 

proposed establishing a separate standard for employment 

cdmpetencies. 

tegislatioh introduced ir^ the 99th Congress would have miended the act 
to require the Secretary to establish a competency standard. The Senate 
Committee on Labor and Human Resources deter^^ that a statutory 
chsuige was hot necessary but affirmed its desire for Labor to proceed 
with plans to establfeh a separate standard. Labor, however, does not 
believe it has the data it needs to set such a standard. 

A separate standard might increase the emphasis oh improvihg the 
emplbyability skiUs of youth rather than just placing them in jobs. Cur- 
rent policy may, however, provide enough emphasis on employability 
enhance^nent. gag lacks a sufficient basis to take a position on whether 
or not a competency standard should be set. 

But if Labor were to set such a standard based oh the^data it now col- 
lects^ it would measure only how many successful tenninations were due 
to attainment of employment competencies^ not how successful local 
progfams were in increasing emplbyability of ybUths deficient in compe- 
tencies. This is because Labor is hot allowed by omb to collect ihforma- 
tibh oh youths who obtain competencies, only on those who attain 
competencies while in the program, but did not get jobs or have other 
successful outcomes (such as returning to full-time school). 
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ReCOininendatidn to the secretary of L^bor should (1) recdminend that states actjust the per- 
^prptp r\7 nf T ahra' formance standards tb take iritb accoimt the differences m locS compe- 

oeci etciry OI LiaDOr tency systems and (2) provide technical assistance to help states make 

these ac^justments. 



ReCOrnmendatioh to the Congress chooses to require a separate youth employment compe- 

p ^ tency performance standard, gao recommends that the standard apply 

t^ongreSS to all youths who attain competencies and that the act be amended to 

enable Labor to collect the data necessary to set and implement such a 

standard. 



Agency GoittrtientS tabor concurred with gao's recommendation to the Secretaiy and indi- 

cated its intent to implement it. oivm cdmm that one concern that 
led it to disapprove part of Labor's 1986 data eollectioh request was 
that the proposed data collection would encroach on the local preroga- 
tive to def me competencies and competency systems, gao does not agree 
with OMB, however, because each private industiy council \vbuld still 
decide whether to provide competency-based training, which mgjor 
areas to ir.clude, and, within each area, the definitions of deficiencies 
and attainments^ <^b's other rngjor concem was that the data would be 
used to develop a very detailed performance measure that could not be 
applied fairly to different local programs, gao believes the adljustments 
described in the recommendation to Labor, if used by states and local 
programs, would provide a foundation for meaningful and fair perform- 
ance measures. 
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Chapter 1 — 

Ihtroductioii 



The Job Training Partnership Act (jtpa) has been the nation's primary 
federally funded employineht and trauning prbgram since it replaced the 
Gdmprehehsive Employment and Training Act (geta) in Gctober 1983. 
Title II-A of JTPA established a training program for disadvantaged 
adults and youths^ funded at about $1.9 billion annually through pro- 
gram year 1985 and about $178 bilUon fdrpro^m year 1986.^ Job 
training services are provided through local service delivery areas 
(SDAs), which may be organized variously to include one or more units of 
local government or even the entire state. 

Except for summer emplbyrneht and trainihg programs, all jtpa youth 
programs operated by sdas are provided under title ii-A of the act, 
which requires that local snAs generally spend at least 40 percent of 
their title II-A funds on youth.^ In program year 1984, the latest year for 
which data were available when this review was done, $539.7 million or 
39 percent of the $1^37 billion spent by the 582 sdas m the states and 
the District of Colvunbia went to youth training. The proportions spent 
by the individual programs ranged from 15 to 68 percent. 

Each service delivery area must have a locsi private industry council 
which, among other things, provides policy guidance and oversight and 
determines procedures for the development of the sda's job training 
plan. These plans describe such aspects of prdgrajn operation as ser- 
vices to be provided, their estimated duration and cost, and procedures 
for selecting pmticipants. A m^ority of the local coimcil's meiabere 
must be business leaders, and its other members are to represent organ- 
ized labor^ community-based organizations^ and educational, rehabilita- 
tion, ecbridritic development, and public emplbyrneht service agencies. 

Within a state, the governor must review and ^prove each sda's job 
training plan. The state is also responsible for administering jtpa per- 
formance standards by which local program effectiveness is evaluated. 



Perf bnriahce StaildardS ^^^^ national performance standard established by the Department 
^ ^ , 1^ ^ of Labor for JTPAtitle II-A programLS, the state sets a numerical value for 

lOf lOUtn rfOgranlS each of its SDAS. For each sda, the state may acyust the numerical value 



yIPA^sp_K)gram yeM• begi^ I and_ends June 30 the following year. Thus, program year 1986 
began July 1, 1986, and ends June 3d, 1987. 

^Ah ddditional $769.5 nulUoh was all(xated to be spent in the summer of 19^ for youth imder Utie 
n-B in the Summer Youth Employment and Training lYogram. We did not include title II-B programs 
in this review because JTPA performance standards do not apply to them. 
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Chapter! _ 
Introduction 



of the national standards to take into account IdcaLgedgraphic, demo- 
graphiCj economic,_£md prograinmatic For example, the 

national standard for the "entered employment rate" for youths in pro- 
gram year^gSBfe^ 43 percent, but if an sda^s local unemployment rate is 
higher tihan the national average, the state may agree to decrease that 
SDA's standard to perhaps 30 percent because it will find it harder to 
place youths in jobs. Measured s^aihst these standards, the sdas within 
a state compete for incentive grants awarded by the state on the basis of 
local progrmn performance.^ 

If an SEft does not meet performance criteria, the state provides tech- 
nical assistance. In the event of continued ftKm-e, the state imposes a 
rebrgsmizatioh plmt that restructures the private industry council, pro- 
hibits the use of designated service providers^ shifts administrative 
responsibility to another grganizatidn, or makes other changes deemed 
necessary to improve performance. 

The act requires each state to set aside 6 percent of itstitle II-A alloca- 
tion for incentive grants and/pr technical assistance.* The process and 
relationships involved in jRinding, setting perft)rmanee standards, and 
awarding incentive grants are showrt in figure 1.1. 



^inoentiye ^^ts alro may be based on providing servicra to the hard-to^rve, such as school drop- 
outs, who are less iiiceiy to get Jobs: 

^No data are available at the national level on how th(^ 6 percent set-aside funds have been spent 



13 




GAa/lfflD^T-aa youth Competendes 



ERIC 



Chapter 1 
tiitrodiictibii 




Establishes hatlbhal 
petformarice siahdards for 
li'A programs. 
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Under the act, performance by local programs is measured in terms of 
increases in pmticipants' employtnent and earnings and reductions in 
welfare dependency. As a result, perfdrrriahce standards have focused 
primarily on placing participants in jbbs^^ But the act Sso acknowledges 
that for ybuthsHttmediate job placement is not the only desirable (or 
positive) outcome. In some cases, placement In a job would be Undesir- 
able; for example^ it would be uhdesirable for in-schodl youths if it 
resulted in their dropping but of school. Thus, section 106 of the act also 
identifies other pbsitiveoutcomes that enhance a youth's employability , 
mcluding compieting a m^jor level of education (elementary ^ secondary, 
or postsecondaiy or the equivalent)^ enrolling in other nbntitle II 
training programs, and attaining youth emp^lbjonent competencies (skills 
that improve employability) approved by the local private industry 
council. 

For youth training programs, the Secretary of Labor has established 
three standards: 

• How many youths are placed in jobs; 

• The total number of positive terminations (outcomes^ including job 
placements and all putcbmes that enhance erhplbyability; and 

• The average cost of each positive tennination. 

None of these st^dards focuses solely on attainment of employment 
competencies, but the positive termination standard can include the 
attainment of competencies. 

Some Member^ of Congress have expressed interest in establishment by 
Labor of a youth competency standard separate from tihe three existing 
standards. For example, the chairman bf the Senate Subcommittee on 
EmplcQoneht and Prbduetivity, Gommittee on Labor and Human 
R^ourees, in esdrly lg86 introduced legislation that would have 
smiended the act to require that Labor establish a youth competency 
standard by July 1986.^ This proposal was prompted by a cbhcern that 
the perlprmance standatrds for ybuth prbgrams, by focusing too much 
bn jbb placement, may give sdas a disincentive to provide competency 
training. 



^tabor does not intend to ^tablish any standards to measure the economic benefits (including reduc- 
tioii-in welfare dependency) of participants' employmeht after they leave the program until July 
1988, when data will be available for them to do so. 

2069, 99th Congress, 2d Sess., the Jbb Training Partnership Act Amendment of 1986. 



1 ^ 

Page 13 - * ^ GAO/imM7-33 Youth Competenciefl 



CKapter 1 
Introduction 



GAO, testifying bh this proposal in March 1986, noted that establishing 
such a stand^^d was mtrealfe^ at that ttihe becausejiate the 
necessary data to set numerical values and design a method by which 
states could ac(just the standard to take into account differences among 
SDAs within a stated Later, the Committee bh Labor and Human 
Resources deleted the proposal as an imhecessaiy statutory change, 
noting that process ^eady was being made towsSd developing youth 
competency standards, including collection of necessary data. (At the 
time the prcqposal was deleted— June 1986— Labor had informed omb 
that it intehded to establish a standard for youth cbihpetehcy attain- 
ment. Althbu^ €ftS had deraed Labor's request to collect data Labor 
believed necessary to set such a stand^d. Labor had appealed the deci- 
sion and was waiting for a decision on the aE^al.) The committee reiter- 
ated its "resolve and cbnututmeht'' to youth TOmpetehcy standards, 
hbwever, and instructed Labbr tb report baelc to the comndttee if such a 
standard is hot implemented by the beginning of program yesoc 1987 
(July 1987).8 



Ck)mpetency-Based 
Training Viewed as 
Important for Youth 



As a general ebheept, a ebmpetehey-based approach to learning focuses 
oh (1) defihihg the content to be lesoried, (2) assessing what the learner 
already knows, (3) providing learning experiences intended to lead to 
the desired^ defined btitcbnie^ and (4^ evMiatiiig whether the learner 
has attained the desired khbwledge or skills. With the renewed emphasis 
bh basi^ m education, many public sdtools are develbpihg standardized, 
objective measures of competence that can be applied when a youth 
completes a grade or graduates.® 

In the emplbjoheht and trjiihing cbmrhuhity, the competency-based 
approach is generally viewed as an important strategy for improving 
youths' employability.^o Competency-based employment training did not^ 
however^ originate with jtpa. It has been used in the Job Corps, and 

^ Job Traini ng Partn e r ship Act Am c hdin c hts ^ bf 1986 : Meanng Before^t^^ SuJbKMnutiittee on _&nplpy' 
ment and Btxiuctivityj Senate Committee on Labor and Human Resources, 99th Cong.» 2d Sess., 99- 
681 (statement of WiUiam J. Gainer). 

Rep. No. 99^17, 99th C^ng., 2d Sess., Ainehdiflg^heJe l) Trairiihg^^arih e rship t Act. Committee on 
Labor and Human Resources, June 5, 1986. 

^Centetfor Employmentand Income Studis, BrandeisUnivetsity, An Igitroducdon to Competency - 
Based Emp lo yment and Ttainiiig Programs for Ybiith Under the Job Training Partnership Act, pre- 
pared for the Department of Labor (Waltham, MA: 1983). 

^^NadonaJ AssodaUon oJf Private Industry Councils^ Youth Programs and the Job Training Partner- 
ship Act, Implementing Competency Standards, 1986. 
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voeatibn^ educatore hav used it widely, buildmg prograrns arpxmd spe- 
cific measurable skills needed in the worlg)lace. After detenninirig 
which workplace skills an indiyiduai needs but does hot possess, 
training can be tailored to the individual's defieieneies. According to one 
researcher, edueatore^also suppo^^^ this ^proach because it helps ensure 
that curricula are more directly related to work requirements." 



Gompeteney^ased 
Systems in JTPA 



The act does hot prescribe specific employment competencies in which 
youths s^e to be txamed; it only requires that locsQ private industry 
councils approve them, thus, the act stresses the impdrtaht role of locsi 
labor market needs and expectetidns in the design of cdmpetehey-based 
training. If cbmpetehcies are based oh loeS employere' needs and expec- 
tations for entiy-level positions, youths who attain these competencies 
eoxdd be expected to be "employment-competent" in the local labor 
market. 



To be emplojnrneht-cbmp^^ an entry-level position, a person needs 

more than the oceupati(m sldlls required to perform a specific job. In 
fact, a wide variety of studies agree*^ t^at employers are hot necessarily 
looking jfor entry-level employees who possess specific job skills, but 
rather pefsdhs who uhderstahd and demonstrate appropriate work 
behavior and have the basic language and mathematics skills needed to 
leani specific occupational skills. 

The Depp^ment of Labor has identified three m^br competency sa-eas 
in which SiSAs may train ybuths and reebrd their competency attain- 
ments^ positive tenhfc but one of the msijor areas (pre-employ- 
ment/work maturity) has two componentSi^ which some sdas have 
treated as separate areas. Local private industry cbuhcils select specific 
competencies from bhe or mbre bf these areas to include in their sdas' 
cbmpetehey systems. The three major areas are: 



Pre-emp loy ment skills ffinding^md^ etang^iob^ include awareness bf 
the world of work, labor market khbwledge, bccupatibhal information, 
career planmn and decision-making, and job search techniques. Work 
maturity skills Thblding a Job and advancing ) include positive work 



"Gerri JFMa» Benchmarkiiifl and Assessment! An Ap pi-oach4x> Developlii^ Youth Emp lo yment Com- 
petency Systems (Olympus Publishing Company, June 7, 1982). 



^^Smokey House Prefect, 2 



er% Work Manual (Danby, VT: 1984). 
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habits, attitudes, and behaviors, such as punctuality, regular attend- 
ance, neat appearance^ good worldng relatior^hips, followiiig instruc- 
tions, and showing initiative and reliability. 

• Basic education sta lls include mathematical computation, reading com- 
prehensibh, writing, speakings listening, viewing, nonverbal cdnutiunica- 
tibh, and the capacity to use these skills in the workplace. 

• Job-specific slalls include proficiencies in performing actual tasks and 
technical functions required by particular jobs, occupational clusters, or 
employmeht fields. Secondary job-specific skills include familiarity with 
and the abilitj'^ to use setup procedures, safety measures, work-related 
terminology, record keeping, tools, equipment, and breakdown smd 
cleanup routines. 



Labor defines the circumstahces under which youths trained in employ- 
ment eompeteheies can be counted toward meeting performance stan- 
dards. In June 1986, Labor issued reportmg requirements that defined a 
•'sufficiently develc^d" competency system — that is, what features it 
must include for the sn\ to count competency attainment as a positive 
termihatibh.^3 In the spring of 1986, Labor also distributed to all states 
and service detivery^eas a^etefled technical ^sistmtee manual to fur- 
ther explain what Labor viewed as a sufficiently developed system:*^ 



Prior to the June 1986 repbrting requirements^ Labor had hbt defined 
requirements for suf f ieiaiitly develbped youth emplbymeht competency 
systems. During jtpa's first 3 years, tabor gave locsd areas ^d states 
advisory guidance througli a technical assistance manual developed 
under cpntract by Brandeis University.*^ Labor also provided some lim- 
ited training during annual performance standard training cbnferences. 

In its new reporting requirements. Labor specifies that before an sda can 
count youths as positive competency terminations, it must have a suffi- 
ciently develbped cbmpetency system that includes several structural 
and procedural elements. TheSve elements, expanded upbn in Labor's 
new technicsd assistance manual, sre: 



* ^Department of taboc, Employment and Training Administration, "Job Training Partnership Act: 
Anhiial Status Report for Titles U-A and III Programs'* CFederal Register . June 18, .1986). 

'^Nationai Aliiance of Busing, A forstCTts^App roaiji to YG aUr^fm io y ment Comp e^ff^, preparMi 
under contract to Technical Assistance and Training Corporation for the Department of Labor, 
Employment and Training AdminisGtitlon, 1986: 

^^Center for Jinploy^ and £n(»me S^ Aivlntroducabh te^€empete^ 

Based Emp loy ment and Training Fm^rams for_Youth_Under the Job Training Partnership Act, pre- 
pared for tJie Department of tabor (Waltham, MA: 1983). 



Page 16 _ GAb/HRD^74d Youth Competendes 

18 

ERIC- 



! 



Chapter! 
Introduction 



1^ 'lite private mdus^ council must approve competency statements 
that OTe employment-related, quantifiable, mearurable, and verifiable 
and offer proof of gain as a result of program partieipaticat; 

2. Each parttcips^^ for competency training must be assessed at 
the start of the program. 

3. Each participant must have aii employ ability development or educa- 
tion jplari that documents a^essment results and the assignment of the 
participant to the right learning activities at the appropriate worksites. 

4. The system must have focused curricula, training modules, or 
behavior modification approaches that teach the employment competen- 
cies in which youths are found deficient. 

B. The participant's achievement must be evaluated at the end of the 
program. 

B. Each youth should be given a certificate of his/her competency 
attainments. 

7. A youth's cbmpeteney gains achieved through program participation 
must be documented in the youth's files. 



States Have Oversight Although states do not have authority to approve or disapprove the spe- 
w cific sidlls or competencies selected by local private industry councils, 

each state is responsible for determining that the systems through 
which local areas provide training are sufficiently developed. This 
responsibility flows from the state's role in collecttag performance data 
and administering the perforihance standard and incentive awards sys- 
tems. Evert before Labor issued requirements for competency systems in 
June 1986, states were supposed to determine whether a locsQ area had 
a sufficiently developed youth cbmpeteney system before counting com- 
petency attainments in meeting perforiitance standards.^^ 

Information collected by the National Governors' Associlitidn in mid- 
1985, however, raises questions about the extent of state oversight. The 
Asspciatidn surveyed the states regarding their administration of jtpa 
perfonhahce standards. Less than half of the responding states (15 out 

^^Department of Labor, Employment and Training Administration, Performan ce Standards Issuance. 
No. l-PY-84, Jan.3l, 1984. 
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of 34) reported that they had reviewed local SDA youth competency sys- 
tems to determine whether they were sufficiently developed. 



Until program year 1986, Labor did hot systematically collect data front 
all sDAs on youth competency training. Thus diuing jtpa's first 3 yeans, 
no comprehensive data were avsulable on how many seas were imple- 
menting competency systems or how many youths were counted as posi- 
tive terminations for attmnihg competencies. 



Labor officials did not formally request aigjroval to collect any data 
related to youth competency systems 1114983^ they saiu, because they 
beiieved the Office of Management and Budget (OMB) ^vbuld disapprove 
such a request. This belief was not based on any action tedceh by omb oh 
proposed data collection before it was formally submitted for 
Papenvdrk Reductidn Act review. Rather^ according to Labor^ it was 
based oh discussions in which omb officials raised two cdhcerris: (1) that 
it was uhcertam whether enough sdas had competency systems m opera- 
tion to justify data collection and (2) that a definition of an acceptable 
system was lacking. 

In January 1986, as part of its effort to define requirements for compe- 
tency systems. Labor did request omb's approval to revfee the Jim 
Annual Status Report to include data on the number of youths who (1) 
were deficient in any competency area, (2) had attained competencies in 
any competency area, (3) were deficient in each msabr cbmpetehcy area^ 
(4) had attsteed competehaes in each ^ea, said ^5) were counted as^s- 
itive terminations because of attadnment of competencies. Labor planned 
to use these data to establish a separate youth competency standard for 
pfbgramyear 1988. OMS^ however^ approved only the last data item. 
Thus, Labor will have data on the number of youths counted as program 
successes due to competency attainment but hone oh whether other 
youths, such as those placed in jobs or those who entered other training, 
attained any employment competencies that could improve their long- 
term employability. 



Data oil Competency 
Systems Lacking 



Objectives Scope and objectives in conducting this study: 

Methodology 1. Because the act grants local areas substantial autonomy in estab- 

lishihg youth competency systems and because of the lack of data oh 
such systems, we sought information on the extent and nature of the 
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systenuj implemented by the end of prograiti year 1984, the period in 
which our review began. 

2 Giveh the act's empha^^^ program performance and its require- 
ment that attainment of competencies be included as brie riieasure of 
performance, we sought to determine whether the competency data 
reported by snAs to the states gave states ^adequate basis on which to 
judge p>erformanee arid award incentive grants. 

Because of the early stage of developmerit of cdriipetericy systems, we 
did not exainine the role of competency attainments in the incentive 
grants actually awarded at the end of program year 1984. 

To detenhine the extent of implementation durin^program year 1984, 
we sent brief mallgram questidrmaires in April 1985 to all 582 SBtAs 
located in the 50 states arid the District of eoluriibia,'^ asking them 
whether they (1) had silready implemented a competency system, (2) 
were developmg a system, or (3) were not planning a cdriipetericy 
system./8 We also asked for data mdicating the cdriipetency areas incor- 
porated in the systems. Of the 557 sdas that responded to the mailgrsccn, 
389'8 repdrted that they had iriiplemented a youth competency system. 

To obtadn more complete information on the cdriipetericy systems, we (1) 
sent a detailed questidnnaire to a raridbrii sample of 109 of the 386 sdas 
(listed in app. I) that had told us they had aready implemented youth 
empldjorierit competency systems and (2) visited a jud^entally selected 
^bup of eight SE^ (see app. II) to gather informatidri firstharid about 
the operation of their systems. The states from which we obtained infor- 
mation either thrdugh detailed questionnaires or through visits are 
shdwri in figure 1.2. 



'^We did not include the 12 SDAs in the territories in this review. 

'®For our inaflgram survey, we did not define ah "implemented" ^stem^jis Lalwr had not defined 
ai "s^ S3^tem,Each_snA that reported it had implemented a 

system used its own criteria for making this determination. 

*^At the time we sheeted our random -sample, 386 SDAs had repwrted implemehtatipn of a compe- 
tency system^befofe of during program year 1984. After we selected the random sample, three more 
SDAs returned the mallgram r^rting^that they also had implemented systems: Hierefore, a total of 
389 SDAs r^rted implemented systems. 
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Fjgare 1.2: States With One or More Service Delivery Areas Surveyed and Eight Locations Visited by GAO 




9 SDAS Visitea 5y GAO 




States with one or rnore SOA s in GaO's Ouestionaire Sample 



We extensively pretested our"detailed questionnaire with officials from 
local pro^ants. it also reviewed by jtpa progrmn officials from 
Labor and ^veral statra suid by representatives of the National Gover- 
nors' Association and the National Alliance of Biisiness. As a result of 
these reviews and pretests, we made numerous changes and improve- 
ments to the questiomisure. 
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The detailed questibnhaire was msaled to a random sample of 100 sms 
in June 1985. Qf these,^^ told us their competency systems were being 
developed but were not yet implemented, and 87 completed and 
returned the questionnaire. Suteequerit analysis of data from Jim 
Annual Status Reports for pi ograih year 1984 indicated that the 95 sdas 
in bur sample did not differ substjoitially in program sisie^ program per- 
formance, or participant characteristics from the other 289 locations 
believed to have implemented competency systems. (See app. III.) 

For bur visits to eight se^as between July 1985 anu February 1986, we 
desired a stsmdard data collection instrument that closely jaralleled 
the questionnaire but required more detailed information. We selected 
the eight local areas to yield a mix in terms of geographical location, size 
of the title II-A youth program, urb^/rural characteristics, and the 
msybr competency gu-eas in their competent systems (see app. II). 

To accomplish our second olyective— determining whether states had ah 
adequate basis for judging performahee — we compsu-ed the information 
we had obtained abbut youth cbmpeteitcy systems to a criterion that 
was impHcJt iri the states' use of any data element as a performance 
measure on which loc^ programs were to be compared: that the 
reported data element have approximately the same meaning across ^1 
locations. For example, in cbuntihg "enrolled in other nontitle II training 
programs'' as one tj^ of p^^ youth, the state assumes 

it to have approximately the same meaning from one snA to another. 
Thus we used the descriptive information we gathered to determine 
what SDAS meant when they said a ybuth had "attadned employment 
competencies" and examined whether the meaning of that term was 
comparable from one SDA to another. WbbIso interviewed Labor and omb 
officials and reviewed documents related to program administration, 
data collection^ and performance standards. 

We did our review in accordance with generally accepted government 
auditing standards. 
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Nearly all (about 91 percent) of the 32 service delivery areas we sur- 
veyed reported that they had irhplOTientod or were developing compe- 
tency systems by the end of program year 1984, In our review of 
systems implemented by June 1985, we found that 

• Frequently, sqas established cbmpetehey systems because they believed 
it would m^e it e^ier to meet performance standards and the act's 
requirement that sdas spend 40 percent of their title II-A funds on 
youth; 

• In developing cbmpetehey systems, sdas appai'ehtly relied heavily oh 
privatejhdustiy coim infonnatioh oh local employer expectations 
for entry-level employees; 

• Pre-emplojmient and/or work maturity training was the primary type of 
competency training provided by snAs; and 

• Youths still in school were the most typical ehroHees in pre-emplby- 
meht/work matxuity competency programs, but out-of-school youths 
were more typical in basic education and job-specific skill training. 



Extent of 
Implementation 



As of April 1985, about 63 j^erceht of the 582 sdas in the 50 states and 
the District of Columbia reported in response to oui mailgram survey 
that they had "implemented" competency systems, and another 28 per- 
cent said they were developing therh.^ Only about 4 percent reported 
that they neither had nor were developing a system. The remainihg sate 
(about 5 percent) did not report the status of their sj^tems. 



Because* at the time of bur surv^* Labor had hot defined a sufficiently 
developed youth competency system, we did not define the term **imple- 
mented" ih^he ntsdl^am. Each sda made its ovm determination of 
whether it had implemented a sj^tem. To the extent that sdas' compe- 
tency systems do not meet Labor's more specific requirements for a suf^ 
ficiently developed system, the number of sdas that wo»uld how report 
having ah implemented system would be lower. Oh the other hand, some 
SDAS that were developing competency systems macy now have imple- 
mented them. 

^Although 389 of the 557 maUgham respondent said they had impTementMi systerosj data frbiti bur 
sample of 100 of these SD^5 showed a 5.4^percent error rate in describing interns as "ihipiemented" 
rather than "deveioping." Applying that percent to the maijgrarn data yields an estimate of 368 (63 
percent) with implemented competency systems and 163 (28 percent) developing systems. 
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Why SDM EstabUshed 
Competency Systems 



Although the act does net require sdas to establish competency systems^ 
32 of the 87 sqas that responded to our gue^itiohnaire said they had 
^tablished such a system because they believed tjt7e state required oner 
But nearly all (49) of thei 50 sdas that believed they had a choice in 
whether to establish a system said one reason they had done so was the 
belief that such systexns make it easier to meet perforrnance standards 
(see fig, 2,1). Many (32) also believed these systems raake it easier to 
meet the act's requirement that sdas spend 40 percent of their title Il-A 
funds on youth. 



Figure 2.1 : Rea8^^ Giyeh by 50 SDAs 
for Choosing to Establish Yboth 
Employment Competency Systems 
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TOe belief that such systems make it easier to meet performance stan- 
dards receives some support from a cdmparis of JtPA Annual Status 
Report data for SDAs that had implemented systems, were developing 
them, or lacked systems in program year^l984. Locations that were 
already more STC^ on youth performance measures (entered 
employment rate and positive termination rate) had not implemented a 
comi^tency system. Conversely, sdas that had develbped or were imple- 
menting competency systems were those that^ when terminations due to 
competency attau^ were not counted, were less successful on those 
perFonhsmce measures. As sdas without competency systems also were 

^Respondents for five SDAs did not say why they established competency systems. 
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enrolling a higher percentage of high school graduates as well, these dif- 
ferences also may reflect different local area policies and emphases on 
job placements. Appendix IV presents these data. 

State agencies often were a major influence in sdas' decisions to develop 
and implement youth competency systems. In addition to the 32 sdas 
that had established a system because they believed the state required 
it, 40 others said encouragement from the state had influenced their 
decision to do so. 

SDAS within the saitie state sometimes differed in their perceptions of 
whether the state required a youth competenQ^ system. Of the 32 that 
said the state <Md, 21 were from IB^states where other SD^ in our 
sample were also located, sdas from these 10 states had conflicting 
views as to whether the state required a system. In each case, some sdas 
said competency systems were required while others from the same 
state said such systems were not required. When we contacted the state 
JTPA agencies in these 10 states, six told us they did not require the sys- 
tems, while four said they did. 



Private Industry 
Geimeils fenportant in 
Development of 
Gompeteney Systems 



The act is clear that the development of competency systems is a local 
responsibility; the specific competencies taught in an sda are to be 
approved by the private industry council. Labor's 1986 technical assis- 
tance manual emphasizes that competency systems should be based 
largely on local employers' expectations of competencies for entry-level 
employees. 



In this respect, most SDAs apparently relied on the views of council mem- 
bers as a reflection of such expectations rather than using council mem- 
ber as li^dsons to the larger employer community. As shown in figure 
2.2, private industry councils in the 87 sdas responding most often had 
little or no involvement in facilitating contacts with local employers for 
their views on competencies. 
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Figure 2.2: Extent Of Private Industry ^^^B 
Councii involvement as Liaison to Local 
Employer Commuhity (87 SDAs) Activities 
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in one location we visited, however, we founa that the SDA had used a 
formal survey to assess local employee' views. In this particular sda, 
the private industry cbuhcil contracted with a eommuraty college to 
survey employers. Of the 2^200 busin^ses sent the 24-question survey, 
425 replied. SDA officials concluded from the results that employers 
in that locality basically wanted entry-level employees with 
pre-empld5niient/work maturity arid basic education skills. The 
employers preferred to provide the job-specific skill training themselves 
through on-tihe-job training. 

Activities in which council members were most often involved, as shown 
in figure 2.3, were: (1) reviewing proposes of a task force or work 
group, (2) maldh improving the process used in system 

development, (3) providing oversight and policy formulation, and (4) 
assisting in development of competency statements. 
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Figure 2.3: Extent of Private Industry 
Council involvement in Review/ 
Oversight Activities (87 SDAs) 
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The eight SpAs we visited used various organizations and information 
sources in develbpihg their competency systems (see table 2.1). In most 
cases^ the sda staff j^Iayed a pnmary r<Se, but other main sources 
included (1) organizations such as the National Association of Private 
Industry Councils and National Governors' Association, (2) rep^resenta- 
tives of secondary and pbstsecbhdary education inf titUtibhs, (3) the 
sda's prbgrmn operator^, (4) state jtoa agency staff, (5) ebminuhity- 
based orgsmizations, (6) local employee, said (7) the Depsatment of 
Labor. Labor tmions and other business or industry groups were least 
used in developing competency systems. 
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Table 2.1: O^anlzatlons and _ 
Infprtra Used to Deyelbp 

Competency Systems in Eight SDAs 
Visited by QAO 



Organization/information source 



-Number of 
SOAs using 
this source 



SDA/state JTFA agencies: 



Local SDA staff 



Ldcai SPA program operators. 



—SQAsJo-Ossx 



SDAs in other states 



State JTPA agency 

C drripetency-based system that already exisiedJaihe area nnHpr CFTA 

Educai ion anpnnl es: 



— Local secondary education agency 



Vbcatiohal education agency 



State education agency 



Postsecbndary education ageDcy_ 



Pro p rie tar 



Public/private organizations: 



Cbrhmlihity-based orgahlzatidhs 



Prdfessional/public organizations 



Busi ness or indas try grpap s 



-Labor union/organization 



Other: 



Local erhpldyers 



U.S. Depaciroent of Labor 



i aiaterial 



Commercial traihihg packages 



Paid cdhsultahts 



Majsr G(Hnpetency 
Areas Included in 
Systems 



Of the three rriBgor cbmpetericy areas, pre-empldjrment/work maturity 
was most frequently mcluded in sdas' competency systems in program 
yeso: 1984. eompetencies in that area had been approved in all 87 of the 
sms we surveyed, and 84 had trained youths in those competencies. 
Rfty-one SDAS reported that basic education competencies had been 
approved by the private industry council^ and 38 had trained youths in 
th^. Similm^ly, councils in 45 sdas had 2q>proved job-specific competen- 
cies, and 37 trained youths in them during the year (see fig. 2.4). 
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Figure 2.4: Competencies Approved 
and Training Provided in 87 SDAs 

(Program Year 1984) 
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What tjj^s of youths typically are enrolled in competency training pro- 
grams? When we asked each snA for such data relative to its two largest 
programs/^^offieiste prq^ oh 142 pre-employiheht/wbrk 

maturity training programs (see fig. 2.5). In-school youths were the most 
typical enrollees in 106 of these programs. High school seniors^ for 
example^ are frequently enrolled in such programs to help theiti learn 
how to get and keep jobs when they graduate. Respondents also pro- 
vided mformation on 50 basic education prd^ams, citing school drop- 
outs as the most tjnpical enrollees in 42 programs. On the other hand, for 
55 job-specific training programs^ schTOl dropouts arid high school grad- 
uates were the most typical enrollees (34 and 35 programs, respec- 
tively). Students were least often enroHed in basic education £md 
job-specific sldlls training: 



^In developing diif questionnaire, we discovered that aii SDA^ typically could iidt ailswer certain ques- 
tions at^iit competency training in the SDA as a whole, because the answers differed from one pn> 
giram operator to another. Oar solution was to request some information about only their two largest 
competency training programs. 
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Figure 2.5: types of Youths typicaiiy ^^^^^^^H^^IHH 

Ehrblled in the Two Lai^est 

Competeh^y Programs of Each SDA in ^"'"^^ Prognm. 
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When we asked SDas the extent to which they targeted training to eer- 
tairi groups of youths and whether it was avmlabie to ail JTPA partici- 
pmtts, we learned that most often dropouts were targeted, that 
eligibility for competency-based training depended upon the competency 
area, and that problems of distance from the prbgraih or transportation 
sometimes made training unavailable to potential participants, as dis- 
cussed below. 



Youths Targeted Many sdas did not identify any types of youths as priority groups for 

cbmpetency-based training in their sda, as table 2.2 shows. For sdas that 
did, however, the groups most often targeted were: for preHemployment/ 
work maturity training, dropouts (42 sdas) and potential dropouts (41); 
for basic educktidn tra^ dfbjpbuts (21) and other but-bf-sehobl 
ybuths with basic skills deficiencies (15); a^d for job-specific skills 
training, dropouts (17) and unemployed high school graduates (15). 
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Table 2.2: Priority Groups Targeted for ■■■■^■■I^^^^^HHHBHHHBHBHHI^HHHHHH 

Cbmpetehcy Training by IWIajor type of competency training 

Competency Area _ _ _f5iH 

empioymeni/ Basic 

work education Job-specillc 
maturity skiiis skiiis 

Type of youth identified as traihihg priority (84 SPAs) (38 SOAd) (37 SDAs) 



None designated 


32 


16 


15 




- Potential school dropouts 


41 


11 


10 


Students with basic sl<ills deficiencies 


27 


11 


5 


High school seniors 


33 


5 


13 


Highjschool seniors with basic skills 
deficiencies 


- - 23 


8 


8 


Out-of-school youth: 


Drbpoi:*s 


42 


21 


17 


Unemployed high school graduates or 
pnnivalent 


PS 


10 


15 


Youths with basic skills deficiencies 


24 


15 


12 



Youths Eligible to Many sdas permitted all types of In- and outH5f-school youths to partici- 

Participate ^ cdmi^tency trainiilg. As figure 2.6 shows, in-schbdl youths and 

school dropouts were most often ehgible to participate in pre-employ- 
meht/wbric matraity training. In the basic education area, sdas most 
often said they permitted school dropouts to participate. Of the 38 sdas 
offering basic education in their competency system, 36 served schbdl 
dropouts. In the job-specific skills area, students, schck)l dropouts, and 
high seTiddl graduates were allowed to participate with about equal 
frequency. 
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FIglife 2.6: lypes of Youths Permitted 
to Enroll In Competency Training 

(Program Year 1984) 



84 Number of SOAs 
75 




38 




Pre^mployment/ 
Work Maturity 

Area 

^^^^ Students 

tK'J'J-ji;^*?! w 

t^igg^j Dropouts 
Graduates 



Job-Specific 
Skills 



Some SD^ penniti^d oJ^?^ tri-sehool or out-of-school youth to participate 
in certsUn types of cotti^^ency training. Nine sewls allowed only ih-sehool 
youth in p^e-empl^^ym^^^^ ihaturity training, while six allowed 
only but-of-sdhbol ^^U^ ^ such trainihg. In the basic education area, 
only one sm limited tftij gaining to in-school youth; however, 13 limited 
basic education tr2^iUr»^^Qout^ youth. In the job-specific area, 

four sms permitted <>t^^,^-school youth in such training, and seven per- 
mitted only butK>f-5Chi^^ ^S^butft. 

Two of the eight sdAS yisiied used participants' educational status to 
limit tr^ning. For e^^^^% one SDA, which offered training in all three 
competency areas, only but-btschbbl youth in its competehcjr 

programs, because ^ 6^^ viewed but-of-school youth ^ most in 
heed of tr^rung. sd^ oft -^^^ also believed that local school systems pro- 
vided the tr£urUi.g rt^ce^^ for in-school youth. Another sda did nbt 
provide competency A^^^^ to high school graduates or individuals 
who had attained t^^ii'^fterai Equivalency Diploma. This sm trained 
in-sehool youths an^ s^^^^l dr^^uts. 
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Geographical and Political Geographieal locations poUcicai jurisdictions sometimes made 
Barriers to Participation competency-based training unavailable to youths who were otherwise 

eligible. Thirty nine questionnaire re^ondents said that youths living in 
certain geographical areas might be unable to participate in pre-eihploy- 
meht/work maturity training because of distance or transportation 
problems. Eighteen said the same of basic education training and 17, of 
job-specific training. 

In bur visits to eight sdas we found examples of such situations. In a 
large single-county sea, youths who Hved in remote mountain cities were 
unabie to participate in the competency program because of the distance 
and lack of transportation. An sda official estimated that youths in 
these areas constituted about 15 percent of the stuA's youth population. 
In another snA — a large, metropoUtah city — officials estimated that 5 to 
IB percent of the youths lived in parts of the city where transportation 
problems prevented their participation in any title II-A trainingj 
including competency training. 

Several snAs also reported, tix the questionnaire, circumstances in which 
youths hving in some political jurisdictions within the sda were ineligible 
to participate in training conducted in another part of the SdA. We fdiind 
one example of this in our visits to eigpttt sdas. In this case, the sm was 
cbmpdsed of two counties, but, in effect, each county operated as a sepa- 
rate SEA. Qiie cora competency system, but youths in the other 

county were not permitted to participate in it. These two counties^ 
which had been in different service delivery areas under ceta, were 
joined as one sda. under jtpa; at the time of bur visit, however, the pro- 
grams in the two counties had hot been uhified. 



Training Activities for 
Those in Gdrtipetency- 
Based Programs 



In the questionnaire, we asked each sdA. to identify the typical traihlhg 
activities for youths enrolled in its two largest programs that incorpo- 
rated cbmpetehcy-b^edtra^^ in each mstjor competency area. To 
understsmd their responses, one needs to be aware of some of the dif- 
ferent ways youths receive training in jtpa. For example, one youth's 
diUy training activity while in jtpa might be cdmpetehcy-based pre- 
employmeht/work maturity jraining^ while another's might include 
other trairdhg at the same time or before or after a particular 
competency-based trjuning activity. These other training activities 
might be competency-based training in other areas (e.g., basic educa- 
tibri), or activities outside the employment competenQ^ system (e.g., 
classroom trMning in basic education that did not use a competency- 
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Youths puring^Beforei or After 
Competency-Based Training 



based approach). JSuestioimaS responses described the training activi- 
ties for youth, but not all these activities were the ones intended to help 
youths obtain competencies in that maadr area. Some were concurrdit 
with other training activities, and some might have preceded or followed 
the competency-based trmning. 

Section 204 of the act allows a wide variety of training activities 
without defining them in detail; section 205 authorizes and deftnes in 
substantially more detail certain "exemplary youth programs." We 
asked about both types of training. 

SDAs described the training activities foryoutlis enrolled in 140 pre- 
empldyfflent/wbrk maturity programs. Youths served by tiiose program 
operators most typically were involved in counseling (77 programs)^ 
labor market information (72), and exemplary pre-emplojnnent skills 
training (64). 



No. of programs citfng^t 



Typical training activity 



Ndh^xerripiary activities (sectldh 
204of JTPA): - 



Pre- Basic 

employment/ education Job-specific 

work matuHty skills ^ akllls 

(140 programs) (49 programs) (SSpmgrgms) 



24 



13 



Classroom traihihg, occupational skills 
Classrbbrri training, basic education 



45 



13 



40 



Llmited work experience 



11 



12 



O ther work exp grigpce 



29 



dob^earch 



47 



15 



19 



Placemeht 



42 



-20 



Vocational explor atldh 
Couhsejjng - - - 



10 



77 



26 



27 



irketJDtormation 



72 



17 



Exemplary^uth prdgrarris (section 
205 of JTPA): 



15 



Education for empioyment 



^1 



11 



■Pfe-employment skills training 



64 



16 



11 



Entry employment experience, 
full/ part-time 



22 



12 



Tryout entry employment experiencs 



16 



Entry, employment experionce, 
— cooperative education 

School*td-wdrk trahsitibri 



12 



16 



Chapter 2 

Ebdtent and Nature of Implcineiitation of 
Youth Employment Con^tency Systems 



111 49 basic education coitipetehcy prc^ams, youths most ^pically were 
involved, as might be expected, in b^icedueatioh classroom training 
(36 programs). After that, counseiing was most frequently mentioned 
(26 programs). 

For youths in the 55 job-specific skills competency pro-ams, oceupa- 
timiai skiHs classroom tranung was the activity tei whidi they were most 
typically involved (38 programs). After that, counseling, job placement, 
and job search were mentioned most frequently. 

In our visits to ei^t sdaj , we found that pre-employment skill training 
usually was provided in a classroom setting and work maturity skill 
training was usuadly provided in an actual job setting at an employer's 
worksite. Basic educatibn skills, as would be expected, were taught in a 
classroom setting, and job-specific skills were taught both in the class- 
room and oh the job. 
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The Job Training Partnership Act specifies that perfomarice meast^^ 
for youth prdgrains include the attainment of cdinpetehcies. For two 
reasons, however, states and the Efepartment of Labor are limited in 
their Me of attairmtent of youth competencies as a measure of perform- 
ance for title II-A youth programs: 

• Lack of comparability among sdas in the meaning of "competency 
attainment" and 

• Lack of appropn^^ data for establisliing a standard for youth compe- 
tency separate from one that includes other positive outcomes for 
youth. 

Lack of eomp^abiliify^fects both current youth perfonnance stan- 
dards and any future standard using competencies as a measure of per- 
forraance. It stems from SD&s (1) not including the same msybr 
competency areas in their youth competency training systems smd (2) 
adopting widely diffenhg mmimuin requirements for reporting youths 
to the state as program successes due to attainment of competencies. 

With regard to iBck of appropriate nationwide data, as we noted earlier, 
Labor is presently unable to edlleet the data both Labor and gao believe 
needed to establish a meaftihgful youth competency standard. This 
inability stems from omb's disapproval of its data collection proposal, 
thus, any separate cpmpetency standard, if established, would be inade- 
quate to assess the effectiveness of local programs in increasing the 
employability of youths throu^ competency-based training. 



Section 106 of the act requires Labor to establish performance stan- 
dards for adult and youth jtpa prdgrains. Labor has defined seven stan- 
dards — four for adult and three for youth programs (see table 31). the 
act pennits Labor to redefine the standards every 2 years; program year 
1988 is the next time they can be changed. 



Perfomiaiiee Standards 
Set Nationally but May 
Be Ac^'usted by States 
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table 3.1: Title M-A National BHi^H^B^^H^HH^^^^^^^^MI^^Ml^H^^HH 

Perfprmance Standards for Adult and Standard 

Ybuth Training Programs Typo of (hurheiical 

(Program Year 1 986) participant Measure values| 

Adult €frtefed^mp fey fnenf rate ■ Percenjagejof adult terminees 62 percent 
who entered empioyment ai termination. 

Cost per entered emp lo yment - Total expenditures for adults $4,374 
divided by the total number of adults who entered 
emplbyrheht. 

Avera g e wag e_kt_ &ia<^m hourly wage for all $4:91 
adtjUsIWhQjeDlefeJemploymentattnetimeof te^^ 

Welfare entered emp lo yment rate - Percentage of aduU 51 percent 
welfare recipients who entered employment at the time of 
terrhihatibh. : _i 

Youth EpterBd Bmp ioy ment rate - Percentage of youth terminees 43 percent 
■- who entered employment at termination. 

Positive terrilihartibn-fafe - Percentage of youth terminees 75 percent 
VVlth a positive termination (enl^ employment Jor had an 
ernplo3jablJity-iihancingoute^ such as completing a 
major level of education or attaining employment 
competencies). 

Cijst p e^ p bs i tiy b t c rrn i hatibn - Total expenditures for youth $4,900 " 

divided^. toJal_posLtive_yQUth_terminatiQns: 



(^rfent adtilt and youth standards are based oh the actual perfonnahce 
of all, or a representative sample of, sdas across the nation during pro- 
gram year 1984 F^^^ the progi^ year 1986 adult standards, Labor used 
nationwide program year 1984 data that the Department— with omb 
approval— required on the jtpa Annual Statiis Report. This report is 
Labor's only source of data bh participant outcomes and characteristics 
for all of the about 6i9^0 s^ in the nation. Each state collects from its 
sms the data required on the Annual Status Report and forwards it to 
Labor after the close of the program year. Because the Annual Status 
RQ)ort for program year 1984 cbntfiuhed no data on positive termina- 
tibns due tb cbmpetehcy attgraimeht, the Department based the 1986 
youth stmtdards oh program year 1984 data collected from a represen- 
tative sample of about one-third of the sdas across the nation.^ 

Of more irnmediate interest to states mid sdas, however, is the fact that 
each state ^es these standards to judge the perfomance of individual 
sms to determine which receive incentive ^ants for good performance 
and which require technical assistance or ultimately may be reorganized 
because of failure tb meet their standards for 2 yes^s. Before using the 
standards tb judge perfbrin^ce, however, the state may need to ad[just 

^ These data were g^ered throu^ Labor's iob TraWng I>Dingitiidinal Survcsy composed of a sample 
of 3,501 terminees from a representative sample of 194 SDAs. 
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the numerical values for each sua because of local factore that could 
make it appropriate for an sda's standards to be higher or lower than 
the average expected performance. 

For exarrq^le. Labor has identified 14 demographic and economic factors 
(shown in table 3.2) that warrant raising or lowering the youth "entered 
emproytnent rate" for an individual sda. If ail sda's uriemploymeht rate 
(factor 14) is significantly higher than the national jtverage, it is more 
difficult for that sqa to ffiid employment for its participants than it is 
for the /'average" sda. Therefore, other ^ctore being equal, that sda's 
entered employment rate standard should be lower than the national 
standard. On the other hand,:andther stiA may eiqoy a very low uriem- 
ploymerit rate, indicating it should be able to^ace its partidpants m 
jobs more easily than the 'average" sda. As a result, its entered employ- 
ment rate should be higher than that of the "average" sda. 



Table 3.2: tocal Demographic and 
Economic Factors for Adjusting ah 
SDA's "Youth Entered Employment 
Rate" Standard 



5. 


Percent Hispanic 


Increase 


(R. 


Percent Alaskan Native/American Indian 


Increase 


7. 


Percent Asian/Pacific Islander 


Increase 


8; 


Percent dropoats 


Increase 


9^ 


Percent studehts 


Increase 


10. 


Percerit post-high school attendee 


(Decrease) 


11. 


Percent handicapped 


Increase 


12. 


Pern*>nt offendfir 






13. 


Percent welfare recipient 


Increase 


14. 


Uhertlplbyrrieht rate 


Increase 



*JH_is column shows the direction oj change Jtthe jocal factor is iower than the jnational average. If the 
local factor is higher than the national average, the standard would be changed in the opposite direc- 
tion. 



Direction of change 
In the standaid* 



Increase 



Jncrease. 



(Decrease) 



Increase 



Local factor 



1 . Percerit female 



2. Percerit age 14-15 



3. Percent age J 8-21 



4. Percent black 



Similarly, for each national j^erfomance standard, Labor has identified 
local factors that warrant adjustirig the numeneal vSue of an sda's 
standard higher or lower than the nationstl standard. These factors are 
incorporated into regression models that yield specific weights for each 
factor. The weights can vary from factor to factor^ resulting in some 
factors having a greater influence than others on the final value of the 
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staiidard. For example, to a(^just the youth standard for entered employ- 
ment rate, the difference between the local and the natiohal average 
un^plbyiheht rate is given a weight of 1.134 (absolute value). The 
weight for "post-high school attendees," on the other hapl, is 0.023 
(absolute value). ^ 

Labor's methodology sflso reeo^u^ that states may need to make fur- 
ther adjustments beyond those factore identified in the model. For 
example, if there has been a recently announced plant dosing in an sda,^ 
the sea's ability to place participants in jobs during the next year would 
not be accurately reflected by the latest uhemploymeht statistics; there- 
fore, ttte state might choose to decrease that sda's entered employment 
rate below the value produced by the model aiyustments. On the other 
hand> if a large emplcqref is scheduled to open a new facility, the state 
may choose to increase the sea's standard. In recoghitioh of such pos- 
sibifities, the ai^^terneht inethodolo desij^ed by Labor includes a step 
for maidng adjustments for special circumstances.^ 

States are not required^ however, to use the aujyustment ihethbddldgy 
desired by Labor. States may eho^e to develop their own method- 
ology, but it must be systematic and conform to several requirements. 
For example, the procedure must be consistently applied among the sdas 
and must be objective and equitable thrpughdUt the state. The adyust- 
meht factors used by the state must be limited to 

• economic factors, 

• labor market conditions, 

• characteiistics of the ix)pUlatidh to be served, 

• geographic fsietbrs, and 

• typ^ of services to be provided. 

Althou^ states need not use Lator's adjustment methodblbejr, the 
National Governors' Association found in its survey of states in 1985 
that 40 states (82 percent) of the 49 that responded to the survey 
pianned to use Labor's adjusSnent methodology for setting program 
year 1985 performance standards. 



^For a detailed technic^ assistance guide to these further acUustmehtSj ^ Nadbnal A^dciatibn of 
Coimties, National Governors* Assodatioh, and National Association of.Mvate Indusby Councils, 
Bey ond the Modeh An Approach to Negotiating JTPA Performance Standards, February 1986. 
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Data Comparability 
ft-obloiis Limit 
Meaiiingf Illness of 
Standards 



As a performance measure, attamment of competencies differs signifi- 
cantly from other measures in the degree of autonomy granted to the 
Ideal SDA. For example, although Labor has not in fact provided very 
specific definitions of program tenns, such as "entered emplo3anent," 
the act does not limit its authority to do so for the purpose of measuring 
how many participants are placed in unsubsidized employment. The act 
makes it clear, however, that youth competehcies are to be defined 
("recognized") by the local private industry councfl^ Accordin^y, 
h^her tabor hw tiie state is authoi^ed to define the content of specific 
competencies for local areas. This requirement reflects the view that 
appropriate competencies may vary in different IbcaQ areas, makihg it 
undesirable for Labor or the state to prescribe the specific competencies 
taught at the local level. 



Labor and the states do, however, have a direct role in the performance 
standards arena. Labor has clear authority and responsibility for estab- 
lishii^ hatibhal performance standards, and each state has clear 
authority and responsibility for appl3ring those peif ormance standards 
to the sms within that state, including a^usting the standards to pro- 
vide comparability for sdas in the state. Each state also has the respk)hsi- 
bility to ^tablish procedures for awarding incentive grants based oh the 
SDAs' pMBrformanee as measured agstthst the perfbrmahce standards. 



Labor recently defined the requirements for a "sufficiently developed" 
youth competency system. Requiring that aU cbrtipetehcy systems have 
these saiae structural and procedural elements is one way to move 
toward cbinparabiHty m the meaning of competency attainment. Our 
review of program year 1984 systems, however, suggests that two com- 
parability problems not addressed by Labor's systemic reqliiremehts can 
continue to impair the usefulness of the present positive termihatibh 
rate standard or bf any futm-e youth competency standard: the number 
of m^uor BTeta& in competency systems and the criteria for reporting pos- 
itive terminations due to attainment of competencies. Both are discussed 
below. 



Labor's Definition of a Labor's reporting requirements, effective July 1986, specify that, to be 

Sufficiently Developed reported as a positive compNetency termination, a youth must dembh- 

System str ate proficiency in at least one bf the three mgjbr cbmpeteriq^ areas in 

which he/she was deficient at ehrbllmeht: The youth's conipetehcy gains 
m pre-anploymer^^^ education, and/or job-specific 

skilis must be achieved through participation in a competency system 
that Incorporates several structiu^al and procedural elements. As 
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described earlier^ the system must include (1) quantifiable learning 
objectives, (2) related curricula training modules, (3) pre- and postas- 
sessment, (4) employabflity planning, (5) documentation, and (6) certifi- 
cation. To illustrate some of the diversity that existed prior to Labor's 
reporting requirements, aj^ndixes V to VIII describe the competencies 
approved in the eight sDAs we visited, and appendixes K and X describe 
the initial and postassessmeht metltods used. 

We believe that Labor, by providing this definitibri, has taken ah essen- 
tial step toward assuring that competency performance data are consis- 
tent. As described below, however, some def irutionai problems remain. 



Number of M^or Areas in The number of msyor competency areas included in sdas' youth eompe- 
Gompetency Systems ^^^^y systems durihg program year 1984 differed. This divereity can 

Differs continue under Labor's present definition of an acceptable system 

because that definition only requires that at least one of the rtijadr com- 
petency areas be included in a system. Of the 87 sDAs that responded to 
our questionnmre, 37 provided training in only one eompetehey area, 
with 34 providing training only in the pre-einployment and/or work 
maturity areas. Twenty-eight seeas provided training in two competency 
areas, and 22 in all three areas, the competency area combinations pro- 
vided by SDAS are shown in figure 3.1. 
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Impiications for Performance The difference in areas included in competency systems means that sdas 

Standards and Ine^ttve Awards are likely to differ also in that some are delivering training that takes 

longer to complete (thus increasing the cost per positive termination- 
one of the performance standards) and some are prbvidihg training less 
likely to be completed satisfactorily by the participante (thus decreasing 
the positive termination rate — another performance standard). 

Pre-empldymeht competencies typically can be attained in significantly 
less time than other types of competencies. For example, as shown in 
table 3.3, in six of the eight sdas we visited, the maximum time spent on 
pre-employment skills was less than 50 hours, and in one case it was 
drily 3 hours. In contrast, for the other competency areas, the time spent 
was often several hundred hours. 
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Table il.ShMaximam CQmpetency 

Training Hours In the Frogram Designs 
bLMIaJdr Cbhtractprs/Trainers of Eight 
SDAsyisltsdbyGAO 

(Program Year 1984) 





TvDe of traininci (no. of hours] 






Pre- 

-eroployment 


Work 
maturity 


Basic 
education 


Job-specific 
skills 


South Florida Employment and 
Training Consortium 


12- 13 


a 


320-605 


375-650 


Bourde^r County 


20-36 


a 


a 


a 


Pacific Mountain Consortiom 




b 


52 


210 


TrI'Coanty Consortium 


48 


a 


a 


a 


City of Pittsburgh 


30 


30 


a 


a 


Dutchess/Putnam 


90 


500 . _ 


330-996 


a 


City of Shreveport 




b 


a 


420-960 


City of tos Angeles 


25-120 


250-1.080 


120-2^ 


a 



°The SDA's title ll-A conipetehcy training system did hot include training in these competency areas. 
•Work maturity training was combined with job-specific skills training. 

We recdgnize that Labor's hew requiremehts for eompetehey systems 
cbrhbihe pre-employment sxtd woiic maturity competencies into one 
major^ea. To the extent that sdias provide training in both of these, the 
discrepmo^ in training time could be alleviated. But three of the eight 
SDAS we visited did not include work maturity training in their compe- 
tency systems (see table 3.3). sdas that did not offer woric maturity 
training could iheoiporate it into their competency systems but enroll 
very few youths in this training and those primarily in pre-employment 
training. To the extent that any sdas adopt this practice, the discrepancy 
in training time for major areas would continue. 



I¥e-employineht training is also characterized by some as less risky for 
the SDA because it is more likely to be cdmpletMsatisfartb^^ by partici- 
pants than is basic edticatidn or job-specific skills training. In the latter 
two competency areas, youths have to stay m the program longer to 
attain eompet^eies, £md the skills being taught may be more difficult to 
acquire. For example, school dropouts could tend to be high risks in 
basic education training programs because they have already dropped 
out of this type of trmnihg once before. Also, if a primary reason for 
dropping but bf school the Twst time was to get a job, they may be 
imwilKhg to remstth, without a job, in a jtpa basic education program 
long enough to attain competencies. 



The difference in areas included in aix SDA's eompefc^cy system also 
ihvblves differences in the Ukelihbbd of meeting or exceeding perfonn- 
^ce standards. Thus, the design of the competency system has a direct 
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relationship to the incentive awards, which, in turn, influence subse- 
quent SDA decisions about what training to provide. Gompetency attain- 
ment is hot the same thmg from one sda to another if in one case it may 
mean only attainment of that involve little investment of 

resources and risk of failure (e.g., pre-empldyment diily), but in another 
may mean quite the opjidsite Ce.g., 2UI three cbihpeteney areas). Yet the 
iricehtive awards could treat these hohcomparable outcomes the same. 
The ri^idt woifld be not only potentially distributing funds inequitably 
but also discouraj^g sdas from providing a full range of competency 
training. These observations apply to both the current positive termina- 
tion fate standard and any separate competency standstt-ds established 
in the future. 



hnpllcations for Basic Education 
IVaihihg 



Figure 3.2: Number of SDAs Serving 
School propouts and Off erinj Basic 
Education Competency Training 

(Program Year 1984) 



Another implication of hot all sbAs' offering training in the same compe- 
tency areas is that youths, ev^ tiiose with similar skiU deficiencies, 
may find thei^ traihihg needs more fully met in some sdas than in others. 
This possibility was evident from the responses to our survey question- 
naire. As shown in figure 3,2^ 77 SMs said they allowed school dropouts 
to enrdU in competency training, but less than half of them (36) induded 
basic educatibh in their competency systems. 
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A training program that provides oiUy pre-employment ahd/br work 
maturity traihihg may be of limited value for youths, such as dropouts, 
who lack basic education s^dlls and therefore are likely to develop 
chronic emplo problems. For high school dropouts, labor market 
opportmiities are poor, their unemployment rates are far higher than 
those of their g-aduate cbimteiTarts, and they are less likely even to be 
seeking work. Dropouts who are employed have lower earnings, are 
more likely to be in semisldlled manusd jobs, and report being in lower 
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quality jobs (e.g., ^th ^ter wdrldiig cbnditions).^ lliese conditions are 
hot surprising beca^^ ^^uts generally lack the basic education sWUs 
needed to successf i^y ^^^r higher quality entry-level positions. 

We recognize that ^^Jttiay provide basic edUeatidh training hot part 
of the cx)mpeteh^ youth ehroHees mxy have access to 

basic education trai^^^ the local school system or other com- 

munity organization^, ^^^ertheiess^ the importance of access to basic 
education training li^^^cbted Labor's interest in ihcbipdrating 
basic education iht^ ^ ^^9ar3 for youth competency attaihment. 
I^partmental goaj^ Set^ year 1986 mclu an intent to require 
in jprbgram year 19^ t^^^^ an SnA*s youth competency system must 
include basic educa^l^J^^^^t: just pre-employment/wbrlc maturity) in 
order to r^rt att^i^*^^^ of competencies as a positive tenhinatioh. 
However, since di^^^rbved Labor's recent data collection proposal 
oh the basfe that it ^ncf^^^hed on the autJiority of private industry 
councils, Labor doe? ^^^. ^J^esee that sdas be required to 

include basic educatioii^- their systems in prcgraih year 1988. Labor 
believes that oMB ^C^Uld disapprove such a requiremeht on the 
grounds that it eoul^ ^o-oacfiiheht oh local authority. 



Criteria for Reporting 
J^isitive Competency 
Tentiinatiohs Differ 
Substantially 



In addition to the di^^f^*^ iri the humber of competehey areas included 
in competency syst^J^f^^hifieant differehces exist in the way sdas 
define the hramhun^ gains a youth must achieve to be 

reported to the stat^ ^ ^ i^sitive termination due to attainment of com- 
petencies. In the ^h^^^^l guidance, some snAs have imposed stringent 
criteria on themselves, i^'^e btfiere have adopted criteria making it 
easier for a youth tP be^^rted as a positive temination under the 
OOTent perfqrmjmc^ ^t^^^ds. These differences exist in (1) the sdas' 
criteria for definiixg Within a given competency area and (2) the 

number of cdmpetel^cy 0^^^ ^ youth had to complete successfully to be 
reported as a positive t^^^iation. 



Attainment Criteria for Given 
Competency Area Differ 



For each msyor cofti^t^^^ area, we asked each sda tb estimate for its 
two largest competency P^graths how many training hours a youth typ- 
ically heeded tb mee*^ tb^ .^Uhimurtt requirements for being reported as a 
positive terndhatioii' t^f^ ^^e^nses indicated that the minimiun 
requirements can ^^^ficahtly for the same competency area. 

^ School Dropouts: The Ebg ^^^^^^^^^f » he ftbblem (GAO/HRD^6-106BB, June 23, 1986). 
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A closer look at programs for in-school youth iliust rates the difJferences. 
aiAS furnished data on 100 pre-emplc^^OTt/wofk matuntr progranis 
for in-schcldl youth. Some pn^ams required only classroom traihihg or 
only training at a worksite, but othere required both, fii 53 ih-school prd- 
gTOTs reqimring only classroom training, youths on averj^e needed 5i 
training hours to meet the minimum to be reported as a positive tenni- 
natiqn (see table 3.45- On the other haiid^ in 38 iri-schbol programs 
requiring both classroom and worksite traiimg; youths on average 
heeded over twice as many houre (126) to meet Qie minimum 
requiremOTts. 



Table 3.4: training Hoars IVpicaiiy 
Naoded to Meet Minimum 
Bequirementi tp Be Reported as a 
Positive Termination in 53 In-School 
Youth Programs 





N6._pJ 


Hours required lor positive 
termination 


Competency area/iypeiof training 


programs 


- Itfean 


IMedian 


Pre-employment/work matarity: 


Classroom training only 


53 


51 


32 


V^rRsite traihihg ohiy 


9 


87 


36 


Bbth 


38 


_ 126 


145 


dob-specific skHls: 


Classroom training only 


7 


368 


170 


WorKsite training only 


9 


245 


225 


Both 


7 


492 


280 



The snss also f unushed data on 23 joli-specif ic skills programs for in- 
school youth. Again, some prc^ains required only classroom traihihg; 
othei^ required both classroom and worksite tratoung. Youths enrolled in 
seven in-school pro-ams requiring only classroom training, on avera^, 
needed 368 hours of training to meet minimum requirements for being 
reported as a jx)sitive temiihatibh. But youths in seven other prbgramis 
requiring bbth classroom and woifeite traihihg heeded, bh average, sm 
additional 124 houre (492 total) of training to meet mihimum 
requirements. 

These data suggest that the criteria for reporting a ybuth to the state as 
a positive tenninatfon due to attaihmeht bf competencies may be e^ier 
to meet in some SEiAs than in others. In our visits to eight locations, we 
foimd that some did impose more stringent criteria on themselves than 
others (see table 3.3). For example, SDA 1 four designatibh) provided 
bhly pre-employment competency traihihg. Its private industry couhcil 
had apprbved 24 competency^eqim'emehts, of wluch a youth had to 
achieve at least 22 to be reported as a positive termination. This took 
about 40-48 hours of classroom time. By contrast^ SDk 3, which also 
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offered only pre^iriplc^erit eornpetehey traming, had 15 competency 
requirements, but a youth had to achieve only one of the 15 to be 
reported as a positive termination. In this case , achieving one pre- 
employment competency required about 3 or 4 hours of training. 



Numbea^ of Areas Required for Ev^ if two sdas provide training in more than one of the three mgjor 
Competency Attainment Differ competenQ^ areas, there may be differences ampiig them in what consti- 
tutes a ppsitiye tentiinatidn. As shown in table 3.5, sua 2 had instituted 
training in all three of the msobr competency areas, but considered pre- 
emplbyinent and work maturity to be separate areas. To be reported to 
the state as a positive competency termination, a youth had to attain 
competencies in at least three of the four areas. 



Table 3.5: Minimum Requirements for Reporting Positive Termination Due to Attainment of Competencies (8 SDAs) 




wvti ii'O&oiiwy tsaiiiiiiu aioas 






SDA 


Pre- 
emplbymeht 


Wbrlc 
maturity 


Basic 
education 


Job- 
specific 


Mlhlmum requirements for participants 


1 


X 








Attain 22 of 24 competencies approved by the private industry council; 
about 40-48 hours of classroom training. 












2 


X 


X 


X 


X 


Attain cdmpetehcies in three of four areas. 


3 


X 








Reqi jFrements noLset Jnjirogram year 1984; Jib positive terminations, 
teported due to competency attainment. Beginning in program year 1985, 
must attain 1 of 15 approved competencies; about 3-4 hours of classroom 
training. 












4 


X 


X 






Pass 27 of 39 competency requirements. 


6 


X 




X 




A4iiot pri>^am_iri program year 1984; no positive terminations due to 
attainment of competencies reported, and no minimum criteria adopted by 
end of year. 


6 


X 


X 


X 




Attain cbrtipetehcies in all three areas. 


7 


X 


X 




X 


Cjpmplet&Lonly thejD^^ training, consisting of one competency; 
_ about 3 hours of trainino: 


8 


X 




X 


X 


If enrolled in "regular" proarams, attain competency in pre-employment 
and dhe other area; if enrolled in "special" programs, attain only pre- 
ertiplbyrri^rit competencies. 



By contrast^ 7 offered tradning in pre-employmeht, work maturity, 
and jblRjpecific skills biit only required attainment in pfe^niploymeht 
skills to be reported as a positive termination. The pre-emplojanent 
feradbnmg prbg^^ about 3 houre of interest/aptitude testing, 

counseling, information on how to search for a jdb^ and identifying 
sources of further training and education. After completing this short 
session, each youth was asked to identify Ks or her vocational interests 
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and aptitudes. Follbwirig this, a youth could fail to attend any additional 
training but still be reported as a positive termination. 



Differences in SE&s' minimum criteria for reporting positive terminations 
could render meaningless a cbmparisbh of sda performance standard 
statistic that iridude competency attsdnment data. This observation 
applies to both the current positive termination rate standard and any 
separate youth competency standard established in the future. 

In providing their own definitioh of good performance, there is a risk 
that some SEtts might use criteria that make it relatively easy to report 
positive youth terminations. If this occiirs, it could result in standards 
that lack comparability from one sda to another. If sdas that have 
imposed more striiigeht criteria oh themselves perceive that they stre 
losing indehtive award money to others with less stringent criteria, they 
might lower their own criteria to compete for incentives. As a result, 
incentive awards would function to encourage smaller rather than larger 
enhancements of youths' emplbyability. 



Implications for Performance 
Standards and Kicattive Awards 



Acyusting Perforaiaiice 
Standards for Data 
Comparability Problems 



As we pointed out earlier, most states use Labor's methodology to acyust 
the performance standards for Ibcfld demographic and ecbhomic factors. 
States are aware alsb bf the possibility of msddhg additional acyustmehts 
for such faetbre as servie^ provided. These adjustments can be used by 
the state to compensate for the comparability problems in competency 
data reported on the jtpa Annual Status Report. 

Labor's technical assistance guide oh settihg^performOTce standards for 
program year 1986 ihcludes a section on further adjustments by the 
governor of a state.-* It identifies adUustments not recommended Ce.g., 
setting more lenient terminatidn rates for snAs thrt have hb ybuth cbm- 
petertcy systems? and cites several circumstahees in whieli adtjustSitehts 

be desirable (e^g., an sm develops a eontpetehcy system that 
reqmres ffie m£^^ specific elements in each competency 

area, which makes competency attainment more difficult for 
participants). 

The states could instruct sdas to provide detaiied descriptions of their 
competency systems and their minimum criteria for reporting youths as 

^Department of Labor, ESiiployment and Training Administration, Guide f orSetang JTOA41tie4i"A 
Performance Standards for PY 86. June 1986. 
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positive terminations due to attainment of cdmpetehcies. Using this 
information and competency data collected through the state's data cbl- 
leiAibn system, states could develop methods for maidng a varied of 
a^ustments. For exsmple, tiis state could set a lower positive tentiina- 
tion rate for sius that have more stringent criteria for reporting attain- 
ment of competencies and a higher rate for sdas with less stringent 
criteria. Similarly, to account foi^dif^ehces m the msijor competenQ^ 
areas included mth^ youth competenqjr sy^ms, the state could set a 
hi^er positive termination rate for snss that provide only pre-emplby- 
ment/work maturity oDmpetency training and a lower rate for an sda 
that also provides basic educatibh and/br Job-specific competency 
training. Also, the standard for cost per positive tennination for those 
prqvidtog trai^^ education and/or job-specific competencies in 

addition to pre-employment/work maturity could be set higher. 



Labbr's technical assistance guide ^ve^ example of using a 
•'wiSighted avera^^ approach to adljust for prog-am desi^ differences. 
With this approach, an sda's terminees are divided into two (or more^l 
groups, e.g., those in the usual employability enharicemeht programs 
and those in programs in which competency atlaihmente are ^ficult. A 
reasbhable positive termination rate for e^ ^oup is then determined 
and a weighted averse of the standards calculated using the propdition 
of teiroinees in each group as weights. An alternative apprbach wbuld 
be the a<yustment to specific measures described in ''Beyond tfie 
MddeL"^ One way tb use this approaeli wotdd be to apply the weights, 
hbt bh the basis of the activiti^ which youths^e enrolled, but on the 
basis of their reason for being a positive terminatibn. YbUths who are 
"positive" because of attaining cbmpetencies in several areas with strin- 
gent criteria f br attainment in each area would be weighted more 
heavily toward the positive tennination rate than those who are ''posi- 
tive'' only because of easily obtained, in one area such as 
pre-employment/work maturity. 

Althbugh Labbf has informed states that they may need to adjust per- 
formahee stahdm'ds to take into account competency system design 
fesues, there are two limitations, in gag's opinion, to Labbr's actibns as 
of the beginning of program year 1986: 



^NT^nal Assbdatiori of Counties, National Governors' Association, and National Association of Pri- 
vate Industry Councils, Bey ond^helrfodel: An App roach to NegotiaUng JTRA Performance Stan> 
dards. Feb. 1986. " ~ 
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1. Labor has not deariy recommended to ail states and sdas that they 
m^e these a^justoients. An appropriate mechanism for doing so would 
be the Training and Employment Infoimatibh Notice (tein), Labor's pri- 
maiy means of communicating jtpa poUey ihf oitnation; 

2. Labor has disseitiinated the technical assistance guide to all states and 
SDAS and offered training sessions at a few regional locations. The infor- 
mation covered, however^ is much broader than the specific adtjustmehts 
for competency systems. States wHl need substantial additionai assis- 
tance from Labor oh how to obtain the data needed within their state 
and how to make these adUustments. 



Lacking for 

EstabUsluRg 

Competency 



abeparate 
Standard 



In directing Labor to establishperfbniiahce stahds^ds, the act cited sev- 
eral factore for evaduating perfonnance of youth programs^ such as 
placement in imsubsidized employment or achieving an employability- 
enhancing outcome such as completing a m^ubr education level, enrolling 
in other training prograxns or attsanihg employment competencies. Com- 
peteney attaiimieht is eture^^^ as one of several factors in the 

positive termination rate, but appropriate data are lacldng for estab- 
lishing the separate competency standard proposed by the Department 
of Labor and the Senate Conunittee on Labor and Human Resources. 



Use of Youth Competencies Although the act cites competency attainment as aperformarice factor, 
in Current Performance performance standards origmally proposed by Labor did hot include 

Standards competency attaihineht as a measure of good or "positive" performance. 

M^y m the Jim co]^ to the absence of youth competen- 

cies in the proposed standards. As shown in table 3.6^ the originally pro- 
posed standards^ announced in April 1983 while local areas were 
planning their initial jtpA programs, focused strongly bh job placement. 
As a result, critics were eoheerited ttiat service levels for in-school 
youth, school dropouts, and disadvantaged youth could suffter, because 
SDAS might give priority to pensons with greater job placement potential. 
Allowing SEAS to cpimt competency attainment as positive performance, 
it was: hoped, would provide a greater incentive to em-oU those youths 
less likely to be placed in jobs. 
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Table 3.6: PjerfojrmjBnce Standards 








Estabjished by Labor for Title ll-A Youth 




- Standard 


Pr^rams 


Measure 


Originally proposed 


Actual 10/83 to oresant 




Ehtered 

employment rate 


PeriJeDtoi total yoath terminees 
who entered employment at 
termination. 


Same as original proposal. 




Positive 

termination rate 


Percent of youth te_rmiriees___ 
with a pbsiiLve tecminalbn (entered 
employment or achieved an 
employability enhancement. 
exdiudi^Q €orTk3eteney attaihmentli. 


Percent lotaLyouthterminees 
with SL positive termination (entered 
employment or achieviBd ah 
emplbyabillty ehhahcemerit, 
iricludint3_combetency 








attainments): 




Costper positive 
termination 


Total lixpenditares for youth 
divided by the total youth with a 
positive termination. 


Same as original proposal. 



In October 1983, the month when jtfa was initially implemented, Labor 
notified the states that they could cduht youth terminees who attained 
competencies as '^positive terminations" for measmtog the performance 
of SDAs' youth p^ llius, the attainm of competendes— in 

adffitiOTt to job placem employability-enhsmcing outcomes, 

such as retuining to school— became a factor that could influence the 
award of performance incentive grants by the states. Labor itself, how- 
ever, did hot collect any data on the number of positive competency ter- 
mihatiohs for aH SEtts nationwide until July 1986, and these data will 
not be available until after June 1987. 

The impact of cbvuritihg comjpeten^ attainment as a positive termination 
is highlighted by data on the extent to which competenQr attainments 
contributed to positive termination rates in program year 1984. In sdas 
that reported positive competency temunations to the state and for 
which were able to obtain competency termihatibh data, the compe- 
tency termihatibhs sometimes made a sizeable difference in the positive 
termihatiwi rate. For 65 locations in our questionnah-e sample, the 
average jMDsitive termination rate was higher by 21 percent (78 rather 
than 57 percent) when it included the competency terminations than 
when they were not included. 



^Urider tJTie rg^^ by lAbor for the JTPA Annual Status Report, eadi 

P<^tive youth tennination reported by an SDA most be categorized as a p<»itive termination due to 
placement in a Job or to having acdiieved an employabiUty-enhancing outcome, siich as attaining com- 
petencies. A youth caimot be reported in more than one p(»idve tennination category. 
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Options for Use of Three options for a performance standard incdrpdrating ydtlth cdihpe- 

Competency Data in tencies emerged frditi our own analysis arid from our discussions with 

Performance Standards Labor officials, foesa sSt siMf, arid representatives of relevant interest 

^oups. The options are outlined in table 3.7 and discussed in the fol« 

lowing sections. 



Table 3.7; Options for Performance Standards Incorporating Youth Competencies; A Comparisori 



Characteristics 



Option 


Provides a 
separate 

youth 

competency 
standard 


All youths' 
competency 
attainments 
are 

reported 


Labor Is collecting 
data to 

tJeyeLob 

methodology 

for 

Set this competehclea' 
standard adjustment 


1 . Currerit positive termihatidri rate 
(cpmpetency^ttajrmi^ 
with other pnftitiVe terminations) 


No 


No 


Yes 


No 


2. Connpetency termination rate (positive 
terminations due only to competency 
attainment) 


Yes 


No 


Yes 


No 


3. Attaint _cr)mpelency .rate (all 
competency attainments) 


Yes 


Yes 


No 


No 



Op tion 1 . Continuing to count competency attainment as one of several 
factors in th^^posttiv^te munatio a^ ^ standard . This is distinguished 
from the Other twd djptidns primarily by the fact that it does riot consti- 
tute a separate staridard for eriiploymerit e<Mripetericies — a typ^ of 
stmtds^d in which both Labor and some Members of Congress have 
expressed interest. 

Arguments can be riiade both for arid agairist having a separate coritpe- 
tericy staridard, but does not have a basis for supporting either posi- 
tion. Labor and the Senate Committee on Labor and Human Resources 
describe a separate standard as a way to encdurage prdvisidri of 
competency-based training. Labor, for exariiple, has asiserfed that failure 
to collect the data riecessaiy to set a separate competency staridsu-d 
wbtttd cOTitiriue to focus prb^mn design and service delivery on place- 
ment rather than on the employability skills of youth. On the other 
hand, the current performance standards already encdurage sdas to 
implement yduth eriipldjrmerit cdriipetericy systeriis. Labor's prd^arii 
year 1986 guidance on settmg peifontigmce stsmdards poirite out tliat 
the positive termination rate was deliber^ly set at a level that would 
be hard for an sda to attain if it lacks a fully developed yduth compe- 
tency system. Labor's position is that sufficient time has elapsed for 
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SEtAs to have established youth employment competency systems^ so 
states should not set more lenient positive tenninatidn rate standards 
for those that do not have systems in place. Even though the act does 
not require SDAs to establish cbmpetenejr^systems (leaving that decision 
to local discretioh),Jbabor can put at a disad- 

vantage a local program that chooses not to have a competency: system 
or chooses to enroll few youths in cdinpetency-bauPGd training. To estab- 
lish a separate standard would go even further m what some could see 
as an encroachment oh local prerogative. 

Gp tion 2 . Positive terminations due only ^d^dmpetene v attain 
Because this would be a separate standard for emplbymeht competen- 
cies, it would satisfy the cbneerhs_of those m the employment and 
training cbmmuhity who want to provide greater visibility to attainment 
of eompetehcies as a positive outcome for youth. It would isolate termi- 
nations that were positive only as a result of attaining competencies 
from the other positive terminations due to job placement or achieve- 
ment of other emplbyability-erffimtcmg outcomes, such as enrolling in 
other Gaining programs. this option, the separate competency 

standard would refer to the percentage of total youth temiiriatibhs that 
were due only to competency attainments (positive competency termina- 
tipns). With the data collection gmb approved fbr program year 1986 
(the total number of youths with a positive termination due only to com- 
petency attainment). Labor could establish this type of standard (option 
2) for program year 1988. Labor officials, however, do not vievsr such a 
standard as adequate^nbr does gao. As with option 1, under option 2 
these data would not provide infonnatioh about local programs' success 
in increasing the employability of youth, which requires data on 
whether all youth receiving competency training (even those, for 
example, placed in jobs) attained competencies. 

Op tion 3 . Attaihnjeht of competencies bv all y ouths enrolled in an^BA's 
competency p rogram . This option would not focus on whether youths 
were counted as ''positive terminatidns,'; but on whether those who 
entered the program with specific skill deficiencies attsaned those skills 
while in the prc^ram^ Under this approach, one would detennine how 
many youths— even those placed in jobs— -were deficient in emplosonent 
competency skills when they enrolled and then how many attained 
those skills in the local program. It would provide the additional visi- 
bility of a separate standard for employment competencies while at the 
same time encompassing ail those who received competency training. 
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GoHectihg the data hecessaiy to set and impl^heht that standard under 
option 3, Labor could also develop a methodology states could use to 
ac^ust performance standards to coirect for one of the comparability 
problems we found--^Hiif^rences in the competency areas included in 
SDAs' cbmpetehey systems. But the states would still heed to a^ust the 
standard to corfect for differences in the mintinuir^reqtdrements for 
reporting positive competency outcomes. (Under options 1 and 2, states 
would have to develc^ their own adjustment methodologies for both the 
competency areas included in sua cbmpetehey systems and the criteria 
used, since that ihfbmatioh is hot available at the national level.) 



With the current data cpllection procedures^ however, Labor will not be 
able to set a standard of this type (option 35. In January 1986, Labor 
requested (DMB's apprbval tb cbllect the additibhal data, giving its intent 
to establish a standard for competency attsmment in program year 1988 
as one reason for needing the data. Labor wmted to determine the 
number of youths who enrolled with competency deficiencies and the 
hurhber who attained those skills while in the prograrn for each mayor 
competency area as well as fbr those dSicieht in, and attaining cbmpe- 
tencies in, any area. With these data. Labor would have been able not 
only to set a national standard for attainment of employment competen- 
cies but also to develop a methbdblbi^ for states tb use in adjusting the 
standard tb take into cbhsideratibn the m^br competency areas in 
which sa\s were providing training. Lacking those data. Labor does not 
believe it has the data it needs to set a separate competency standard. 

OMB disapproved Labbr's request tb cbllect data bh the humbers bf 
youths who had defidehcies and who attained cbmpet^cies^ omb's posi- 
tion is that the data collection it did approve is sufficient to satisfy 
Labor's statutory mandate to include the attainment of employment 
cbmpetencies in evaluation bf the perfontiance bf youth programs and is 
alsb sufficient for juabor tb establish a separate cbmpetehey standard if 
Labor chooses to do so. in omb's view, collecting data more detailed than 
the number of positive terminations due to attainment of competencies 
would intrude on the local private industry councirs authority to define 
ybuth cbmpetencies aad implement prbgraihs tb meet those cbmpeten- 
cies. OMB officials sdsbdhdicated to us that—other things being equal — 
their decision would probably be the same even if Labor were proposing 
to establish a separate competency standard because the CJongress 
required it. 
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In cbrranentteg oh a of this report, omb further explained the issues 
it considered in making a decision on Labor's request. Those issues are 
discussed at the end of this chapter. 

GAO agrees with OMBthat the data how being collected on the jtpa 
:^nrmsd Status Report are adequate for Labor to include competency 
attainment in some measure of performance. But we do hot agree that 
they are adequate to establish a separate cbmpetehcy standard nor that 
the request for data in itself encroaches on the jocS pro-ams' 
authority. We recognize, however, that omb was acting within its 
authority under the Paperwork Reduction Act to ensure that any prcn 
posed collection of information is— in Omb's bpinioh— necessary for the 
proper performance of the agency's function, does not duplicate existing 
collections, and imposes minimum burden oh the public. 



Conclusions states' respdnsibility under jtpA for awarding incentive grants, 

based on perforihahce, makes it incumbent upoh the states to assure 
that the perfonnahce st^d^^^ is used in a way that results in an 

equitable and appropriate distribution of the money. A state must 
assure that one ruk does not gain an Unreasonable competitive edge over 
another merely because of program design differences or the critena 
used to repMDrt the progr^ succe^^^^ to the state. If that happens, the 
mcentive awards could operate to discourage providing comprehensive 
high-risk training, such as basic education, and to encourage prbvidihg 
yery minimal, IdwK^bst trainir^. States should assure consistency and 
fairness in the application of perf onhahce sti^ndarcte and the awarding 
of ihcentive grants. This cah best be accomplished by a^usting perform- 
ance standards to compensate for differences in program design. Labor 
needs to provide policy support and technical assistance to facilitate 
states' making these ac^jUstmehts. 

If a separate competehcy standard is to be established, we believe that 
the standard should be based on all youths enrolled in an snA-s compe- 
tency prpgram who attained competencies (option 3 in table 3.7). Such a 
standard would assess SDAs' succ^s in youths' attainment of competen- 
cies m those jtt-eas recogaized as important by the local programs. In 
addition. Labor should develop a methodology for states to Use in 
acijusting the standards to account ^of the competency areas in which 
SDAs provide training. In program year 1986, however. Labor is hot col- 
lecting the data necess^ to set ahd develop ah a^ustment method- 
ology for this kihd of standard, and it seems unlikely the omb will 
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approve such data collection unless legislative changes are made to 
clearly establish Labor's authority to do so. 



The Secretary of Labor should (1) recommend that states ac^just the pos- 
itive termihatibn rate and the cost per positive termination standards 
for youth progr^s to compensate for differences m SD^' competency 
systems and (2) provide technicsd assistance to help states make these 
ac^justments. The Secretary should advise the states that the following 
types of acyustments are needed: 

• Set a higher positive tennmatiqn rate for sdas that offer only pre- 
employment/work maturity competency training than for sdas that also 
offer basic education and/or job-specific skills training. 

• Allow a higher cost per positive termiriatibri for sdas that offer more 
costly training, such as training in basic education smd/or job-specific 
skiils than for sdas that provide only pre-employment/work maturity 
skills training. 

• Allow a lower positive termination rate for Sdas that have more strin- 
gent criteria for reporting positive competency terminations to the state 
than for sdas that have less stringent criteria. 



If the Congress chooses to require a separate cbmpetency standard, we 
reebmrnehd that the standard apply to all youths who attmn competen- 
cies ^d that JTPA be amended to enable Labor to collect the data neces- 
sary to establish and develop an ac^ustment methodology for such a 
standard. 



ReeommendatiGn to the 
Secretary of Labor 



Recommendation to the 
Congress 



AfiehCV Comments ^"^^ Department of Labor, in November 20, 1986, comments on a draft 

^ ^ of this report (see app. XII)^ described the reix)it as extreme^ thorough 

in its description of cbmpetency systems as of June 30, 1985, and per- 
ceptive in analyzing and portraying the complexity of issues involved in 
the use of competency attainment data. It concurred with our recom- 
mendation to Labor and expressed the intent to continue to provide 
policy guidance and techmcal assistance to states through the annual 
performance standards technical assistance guide and training cohfer- 
ehees. Labor indicated that it^xpects to give additional emphasis in the 
future to adUusting the performance standards to account for differences 
in local competency programs. 
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The Office of Mahagemehtj^id Budg m November 21, 1986, comments 
on a draft of this report (see zqpp. XIII), confined its remarks to our pre- 
sentation of omb's disapproval of the proposed additional data elements 
for the JTPA Annual Status Report cbhceniirig youth competency attain- 
merit. In omb's bpihibh, bur draft report did hot address adequately the 
concerns that led it to disapprove part of Labor's 1986 data collection 
request. In addition, omb requested that we clarify language that inaccu- 
rately implied that omb had taken action on a i^revibus data '^ollectibn 
request before it was fonnally submitted tb omb for review. This clarifi- 
cation has been made in the final report text (see pp. 18 and 51). 

OMB commented that two major concerns led it to disapprove Labor's 
request: (1) the prc^RDsed data cbllectibn would encroach oh the prerbga- 
tive of the private industry cbuhciis and the states tb define what con- 
stitutes a youth competency mid a youth competency system and (2) the 
data would be used to develop a very detailed performance measure 
that could not be applied fairly across sdas nationwide. 

OMB described the jtpa progrmn as a "p^tnership" between federal, 
state, and local governments and between these governments and the 
private sector as represented by the private industry councils. The Sec- 
retary of Labor is required tb establish performance standards for youth 
programs oh the basis of, among other factbrs, the attainment of 
employment competencies recognized by the private industry council. 
Each private industry council, as part of the partnership, has responsi- 
bility for deciding on the specific competencies in which attgdnineht will 
be assessed, and the act dbes not authbrize the Secretary to define those 
cbmpetehcies or to prescribe what should be included ih a competency- 
based system. 

With this partnership in mind, omb has attempted tb limit regulatbiy 
and paperwbrk requirements so as tb provide maximum flexibility to 
state mid locsd officios, omb said that it agreed with the comments of 
states and local private industry councils that opposed the proposed 
data cpllection on three points: (1) the approved data were sufficient tb 
establish a performance standard, (2) cbllectii^ data on the number of 
youth who attjmted and were deficient in each of the mgjor competency 
OTeas (pre-emplojnnent/work maturity, basic education, and job-specific 
skills) : r in any one of those areas would encfbach bri local aUthbrity to 
define what cbnstitutes a yoUth competency and tb determine what 
shbuld be included ih a youth competency-based training system, and 
(3) those data would not be useful because they vary so much across 
SDAS. To collect the data Labor requested was described by one state as 
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serving to "coerce" SDAs toward the development of youth cbmpetency 
systems designed to obtain high rates of attsonment of eompeteheies — a 
policy seen as <^rectly counter to the intent of the act. omb said that 
state's comments, in effect, summarized the concerns of those who 
olgected to the pressed data collection. 

OMB also was concerned that tabor had not discussed the youth compe- 
tency data elements with the jtpa Perfonnance Standards Advisory 
Committee even though states and private industry councils play such 
critical roles in administering jtpa, (The Committee, which cbhtairied 
representatives from eJl parts of the JtPA system, including states and 
private indus try councils, was establfehed By Labor as a forum for dis- 
cussing performance standards issues.) 

oriB's second m^jdr concern was that the data would be used to develop 
a very detailed performance measure that could hot be ^plied fairly 
across SDAS hatibhwide. omb was concerned about the subjective nature 
of the terms ''deficient" and "attained/' which vary across states and 
SDAS. At the same time, it felt that Labor should not define what the 
heeds of local youth are (i.e., what a "deficiency" is) amd when those 
needs have been met (i.e., what "attainment" is)— that the issue of con- 
sistency of youth competency measures across sdas is properly a ques- 
tion to be resolved by the individual states and their SDAs. 

OMB's first ebneern— that the data eolleetioh would encroach on local 
authority — appears to have two components. Collecting the data is seen, 
in itself, as an encroachment oi. local authority. In addition, to collect 
data that are not necessary to establish a perforinahce standard or to 
collect data that wbUld hbt be useful to Labor are seen as ineonsisteht 
with omb's federsdism and regulatory relief concerns, i.e., they unneces- 
sarily impose reporting requirements on state and local officials. 

We do not agree with omb that requiring inforihatibn bn deficiencies and 
attainments, in itself, eheroaehes oh the authbrity of the private 
industry councils to define competencies and competency systems. Each 
private industry council would still need to decide whether to provide 
competency-based training, which major areas to include in that 
training, arid, within each are^i, the definitions and means of assessing 
defieieheies smd attainments. 



We also believe that the data would be Useful even though local def irii- 
tidris of * 'deficient" arid "attairied" differ. Labbr has established defini- 
tions which will assure some degree of comparability ambng sdas in the 
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data reported. With the data collection it approved, omb also approved 
reporting requirements that describe the three major competency areas 
in which attainiuent can be counted as a ''positive" termination: The 
reik>rtihg requirements also s)^^ competency gains must be 

achieved^d tracked through systems that are "sufficiently devel- 
oped," i.e, that include certain sj)ecific features such as quantifiable 
learning objectives arid pre- and pbstassessment. 

We agree with em that the data elements approved by omb are suffi- 
cient for Labor to meet its statutory misdate to include competency 
attainment in performance standards. But additidnsJ data would be 
needed if a separate competency standard were to be established. Labor 
and some Members of Gongress see a separate standard as a way to 
ericowage local programs to emphasize enhancement of youths' long- 
term employability rather thmi just immediate job placement. But one 
could argue that the current standards put enough emphasis on compe- 
tency attainment, and a separate stahdso-d would put undue pressure on 
sii\s. GAb does not supporting either position. Therefore, 

we are making no recommendation on this matter. 

We believe, however, that if a separate youth employmeht competency 
standard is to be established, mformation on the total number of youth 
who have attmned youth competencies recognized by the private 
industry council will he needed—infonnation that is riot being collected 
at this time (program year 1986). The instructions for reporting data to 
the states arid to Labor explicitly state that youths who entered unsub- 
sidized employment should hot be counted as having "attained pic- 
recogoized youth CTiplosnnent competencies" (even if they attained cdrti- 
petencies), nor should those who are counted as havirig attsiiried any 
other outcome that eriharices their employability (such as entered other 
ribrititle II training). The data^element that would have reported the 
total nranber of youth who attained competencies was disapproved by 
OMB along with other basic data on competency attainment in each of the 
three msgor areas already defiried by Labor. 

RegaurdirigONffi's second m^^ conceni, we agree with omb that states 
and sms have a responsibility to encourage consistency iri the Use of 
youth competency data across SDAs. This cbncern led to bur recbmmeh- 
Uatibri to Labor. We believe that if states, with Labor's assistance, 
develbp methodologies to a^ust for differences among local programs, a 
foratdatioh for meaningful and fair performance measures would be 
established. Our recommendation to the Secretary of Labor regarding 
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a^ustments is intended to help make the curfent perfdnnance rneas- 
Ures^ which include cdnvpetency attainment, and a separate competency 
standard, if one is established, more meaningful and useful to all the 
partners in jtpa. 
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state 


SPA harhe 


SDA Ideation 


Alaska 


Balance of state 


duneau 


Arizona 


Maricopa County® 


Phoenix 


California 


Mariri County 

Richmond City 

Sao Francisco CLty/County 

San Mateo JCounty 

Monterey County® 

Meridbcihb County'' 

Nortec 

Napa County: _ 
Solano County® 
Los Angeles City 
Los Angeles County 
Grange County 


Sail Rafael 
Richmond 
San Francisco 
Redwood City 
Salinas 
Ukiah 
ChLcp 
Napa: 
Fairfield 
Lbs Angeles 
Lbs Angeles 
Santa Ana 


Colorado 


Puebio Consortium® 


Pueblo 


Florida 


Brevard Cdurity 
Northwest 
HjJJsboroughLCounty 
rinenas v^ouniy 


Merritt Island 
Tallahassee 
Tampa j_: 
v^iearwaier 


Georgia 


Clay to rv County 
Heart of Georgia 
Middle Georgia 
. Savannah/Chatham 
Southeast ' 


Jonesboro 

Milledgeville 

Macon 

Savannah 

V^ldosta 


Illinois 


Champaign Cdhsortlum® 

ChLcagp City i _ 

Rock Island Consortium 
lazewell Consortium 
Whiteside Cdnsdrtium 
Will County 


ChamjDaigri 

Chicago 

Rock Island 

Pekin 

Sterling 

Joliet 


Indiana 


Eaat.CentraL Consortium 
Hoosier Falls 
Tecumseh Area 


Portland 

deffersonville 
Covington 


Iowa 


Western Iowa (SDA m)^ 


Sioux City 


Kansas 


Pittsburgir Consortium 
(SDA #5) 


Pittsburgh 


Kentucky 


E: Kentucky CEP 
Ndfth Ceritfal Kentucky 
Northern Kentucky 


Hazard 

Louisville 

Flbrence 


Louisiana 


Fourth Planning District 
Sixth Planning District'^ 
East Baton Rouge 
Orleans Parish 
0 u_a_chita_ Parish 
Stirevenort Gitv 


Op^alousas 
dena - 
BatdrvRouge 
New Orleans 
Mcmrde_i_ 
Shrevenort 




Maine 


Cumberland® 


Portland 


Maryland 


Lower Shore 


Snow Hill 



63 



Page 62 GAO/Ifim^7-33 Yoatti Competencies 



ERIC 



Ap^hdix! - 

Service Deiiyery Aireaa Sent iSAb 
Questioxinatre on Youth Eznployment 
Competency Systems 



State 


^DA name 


SDA location 


Michigan 


Berrlen/Cass/\^ri Bureri 
Ppwnriyer Cpmmunity Conf . 
Eastern Upper Peninsula 

Lansing Tri-County 
Macomb/St. Clair 
Mid-Counties Consortium 
Region 11 Consortium 
Washtenaw/Ann Arbor/ Livingston 
CdnsdrtiUm 


DfjvA/aniap 

Southgata 
Sault Sainte Marie 
Grand Rapids 
Uancing 
Mt. Clemens 
Battle Creek 
Jackson 
Ann Arbor 


Minnesota 

-- 


Duluth City 

Nortb/V\fest Minnesota^ 
Rural Minnesota CEP 


Duluth 
Crookston 
Detrbit Lakes 


Missouri 


Trenton (SDA#1) 
Lake of the Ozarks (SDA #9)^ 
Cape Girardeau (SDA #11)'^ 
Balance of St toals (SDA #13) 
St. Charles (SDA #14) 


Trenton 
Camdenton 
Cape Girardeau 
Clayton 
St. Charles 


Nebraska 


Greater Omaha 


Omaha 


Nevada 


Southern Nevada 


Las Vegas 


New Jersey 


Bergen County 
Camden County 
Cumberlahd/Salem 
W pn m ou t h Cbun ty 
Newark City: _ L 
Snssex.'Warren'^ 


Hackensack 

Stratfbrd 

Bridgetpn 

Asbury Park 

Newark 

Newton 


New-Mexico 


Albuquerque Cohr tium 


Albuquerque 


Mew York 


Buffalo-Erie PIC 
Oyster Bay Conso.^'.:vj>T; 


Oyster Bay 


Ohio 


Scioto Consu tiun; 
CentraLOhio Consorivj • i 
Miami Cbnsbrtiiirn 
Montgomery Consort*^ /." 
Toledo Area 


Portsmouth 

Newark 

TrQy__ 

Dayton 

Toledo 


Oklahoma 


North Central 


W^toriga 


Oregon 


Mid-Willartietta 
Oregon Cbri /brtium 


Salem 
Albany 


Pennsylvania 


Allegheny: Cojisortium 
Beaver County 
Northwestern Cbhsbrtium 
Central Region 
Rhilaclejphia City/County 
Pittsburgh City 
Ybrk County 


Pittsburgh 

New Bhahton 

Ciark 

*^b:*nrLokin 

Philadelphia 

Pittsburgh 

York 


Rhode Island 


Northern Rhbde IJ'and 


Providence 


Tennessee 


Jackson (SDA #12) 
Mc>rristown (SDA #2) 
Nashville/Davidson (SDA #9) 
Dyersburg (SDA #13) 


Jackson 
Morrlstovvn 
Nashville 
Dyersburg 
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State 



SDA name 



SDA Ideation 



Utah 


Southeast Cbhsortiijm 


Price 


Virginia 


Capitol Area_ 


Richmond 




CenXrai Piedmont 


Roones Mill 


Washington 


PENTAD Consortium 


Wenatchee 


Wisconsin 


WOW (SDA #12) 


Waukesha 




West Central (SDA #115 


Menomonie, 



^Among the eight SDAs that did not respond to GAO's questionnaire. 

^Among the fiye SDAs that originajiy indicated a system had been developed, but later in the question- 
naire said that no systen was in place, but the SDA was developing one. 
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South Florida 




Characteristic 


4Miami)_ 


Bottlder (CO) 


Program slze^ 


1,602 


126 


Urban/rural 


Primarily urban 


Urban/rural-^ 
large rural area 


Counties 
Cities 


2 
3 


1 
• 


Major competency areas (program year 1984): 


Pre-employment 


X 




WbrR maturity 


Basic education 


X 




__ dob-sr>ecific skMIs 


X 




Population (total) 


1,813,969 




Ecoriomlcally disadvantaged 


245,004 




Economically disadvantaged youth 


37,(373__ 


^04 


Area (square miles) 


3.088 


748 


Experience in any competency training under 
CETA 


Yeis 


No 


Expenditures 






Title ll-A^ total (program year 1984, in 
thousands) 


$11,138.3 


$499.9 


Ybuth competency training (est. for program 
year 1984) 


Not available 


$29,677 


Required miriLmulm expenditures :on youth 
^program years 1 984-85) (percent) 


31 


40 


Title ll-A allotment spent on youth (program 
year 1984) (percent^ 


29 


13.8 
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Pacific 
JHoUhtaLh 
- eonsorUtun 
(Olympla, WA) 


TH-Cotihty 
Cbhsbrtlum 
(Rock Island, 
It) 


Pittsburgh City 
(TO) 


Dutchess/ 

JPutnum 

(Poughkeepsle, 
NY) 


LoaJ^ngeles 
City(CA) 


Shreveport City 
(LA) 


471 


345 


239 


134 


2,609 


199 


Urban/rural— 4 
rural counties 


Urban/rural 


Urban 


Urban/rural 


Urban 


Urban 


5 
• 


3 
• 


• 

1 


2 
• 


• 

1 


• 

1 




X 


X 


X 


J< 


X 


X 


X 




X 


X 


X 


X 


X 






X 


X 




X 










X 


305,900 


228,367 


423.938 


322,248 


2,966.850 _ _ 


205.820 


39,290 


6,754 _ 


105,410 


33.-477 


764.086 


47^1 


6.00Q 


1.545 


12^ 


3,864 


97,390 


5,898 


6,917 


1,836 


56 


1,058 


464 


100 


No 


Yes 


Y§s 


Yes 


No 


No 


























$2,765.2 


$2,383.4 


$3,135:1 


$949.6 


$20,694.0 


$1,199.4 


$152,159 


$42,170 


$1,983 


$285,657 


$137,143 


$168,196 


38.2 


36.4 


30 


33.3 


39 


40 


39.4 


28 


22 


40.9 


31 


29 



°No. of title ll-A youth terminations in program year 1984. 
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AspecVcharacteiistic 


Mean for 95 
SDAs In 
sample 


-Mean-for 
289 SDAs 
hot In 
sample 


Total terrhihees 


1.261 


1.159 


Youth termlnees 


644 


604 


Funds spent for yoath (percent of title ll-A total) 


37.9 


39.1 


Youth termination data: 


Entered erhplbyrrieht rate (percent) 
ErripJpyabHItyenbancerneMcate®:^^^ 
All positive termlnatiDns_rsrtpa (percent) 


52 
16 
68 


52 
16 
68 


AverageJivage at termination 


$4,19 


$4.11 


Training (average weeRs in program) 


17.5 


17.9 


Youth characteristics (percent): 






Female 


- 49 


49 


Education: 


Dropouts 
Students 
Graduates 


23 
36 
41 


24 
36 
40 


Single parents 


10 


10 


Bace/athnicity: 


White 


55 


61 


Black 


33 


^6 


Hispanic 


8 


9 


American Indian/Alaskan Native 


2 


1 


Asian 


2 


3 


Limited English 


2 


2 


Handle*. , iped 


11 


13 



^Includer e.ny positive terminations due to attainment of competencies reported to Labor in addition to 
data elements on the Annua! Status Report. 
Source: dTPA Annual Status Reports 
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District of Columbia by Qjmpetency System 
Status (Program Year 1984) 









Youth employment competency system status 












No information 




All SDAs 


Implemented 1 




No systems 


available 


Total no; of SDAs 




384 


147 


25^ 


26 


Selected program descriptors: 


Total terminees 












Median 


797 


854 


705 


438 


675 


Lowest 


55 


- 55 


70 


106 


- 122 


Highest 


34.630 


13.706 


8.240 


1.258 


2.128 


Youth terminees 












Median 


332 


357 


262 


1gl 


262 


Lowest 


18 


18 


25 


18 


31 


Highest 


14.125 


6.815 


3,943 


488 


1.010 


Percent funds for ybUth 












Median 


39.0 


39.0 


38.1 


38.6 


37.7 


Lovvest. 


15.1 


15.1 


16.9 


22.5 


24.5 


Highest 


68:3 


67.0 


68,3 


53.4 


51.8 


Average weeks in program 












Mediah 


17 


17 


17 


18 


15 


Lowest 


4 


7 


5 


id 


4 


Highest 


41 


41 


34 


29 


24 


Performance data (positive terminations): 


Entered employment rate (percent) 












Mediah 


55 


53 


57 


68 


52 


Lowest 


7 


7 


13 


38 


18 


Highest 


90 


90 


89 


82 


82 


Eniployabllity enhancement rate^ (percent) 












Median 


4 


4 


6 


3 


3 




0 


d 


Q 


_d 


Q 


Higii«3t^- -- - - 


61- - 


- - ^1 


50 


47 


- 58 


All posiiive termlnatic ;- /ate"' (percent) 












Median 


55 


54 


57 




52 


Lowest 


7 


7 


13 


38 


18 


Hin^e*;^ 


90 


90 


R9 


89 


82 




/-verage wage at ie:: 'in - :;cii 












Median 


$4.03 


$4.03 




$4.01 


$4.15 


I owest 


3.39 


3.39 


3.51 


3.50 


3.59 


r '«ghest 


7:92 


6 5,7 


7^02 


6:45 


5.52 
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Cbmparlsbh of All SI)As in the Statos and die 
IMstrict bf^Ck>ia^ System 
Statos ^^rogram Year 1984) 



Youth empioyment competencg^ system status 





All SDAs 


Implemented. 


DBseloDina 


No systems 


No kiiformation 
available 


Youth characteristics (median percea 












Female 


49 


49 


51 


50 


52 


Education: 












Dropouts 


23 


22 


25 


24 


24 


Students. 
Graduates 


32 
40 


34 
40 


25 
42 


26 
49 


35 
40 


Single parents 


10 


9 


11 


11 


11 


Race/isthhicity: 


White 


61 


63 


52 


64 


53 


Black. _ 


17 


18 


17 


6 


30 


Hispanic 


2 


2 


3 


3 


3 


American Indian/Alaskan 


0 


0 


0 


d 


0 


Asian 




1 


1 


a 


1 


Limited Eng-j&h 




' 1 


1 


1 


1 




9 


9 


8 


9 


11 



^Pn^ 3DA was not jncluded in this summary because it was much larger than the others (34,630 
terminees). 



''Excludes any positive terminations due to attainment of competencies. 
Source: JTPA Annua! Status Reports 
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P^Bmployment/Work Matunty Competencies 
fiiGluded m tfie Youtti COTftpet^iGy Systems of 
Eight SDAs (Program Year 1984) 



Following are the pre-employment/work maturity competencies 
included iii the youth competency training systems of the eight SDAs vis- 
ited by GAO 



SDUth FlOfida ' Assessment rf personal oral language skills. 

^ . • Oral iangua^5^3 irhpro^ omeht. 

LyOnSOrtlUm . Nonverbal c:'mmuni' ation. 

• Oral comn^ ; . .ic dion skills. 

• Job search skills. 

• Completir).^: > applications. 

• Job- interviewing skills. 

• Job- keeping sldHs. 



Boulder Goiuity 



Self concept arid self esteem. 
Interests, skills, and alptitude. 
Job applications. 
Resumes. 
Asseftiveiiess. 
Conflict resolution. 
Stress management: 
Labor market information. 
Motivation. _ 
Values clarification. 
Short-term employment goal. 
Career planning. 
Independent living skills. 
Job search skills. 



Pacific Mountain 
Consortium 



• Work values. 

• Labor market information. 

• Personal irif onriation . 

• Career planning. 

• Job search. 

• Dependability. 

• Work attitude. 

• Responding to supervision. 

• Personal appe^u'ahce. 

• Communication. 
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Appendix V 

Pi^Emplb^eht/Wdrk Maturity 
C^nipetendeslnd^^ Youth 
Competency Systems of Eight Sfitte (Program 
Year 1984) 



^ — -rr — — 

HttSburgh City • Problem solving 

^ ^ • Person^ health/hygiene/grooming/dress. 

• Money management. 

• Self-assessment. 

• Career awareness. 

• Labor market information. 

• Wages fnhge benefits. 

• Career planning. 

• Team work. 

• Resumes. 

• Reference selection. 

• Gompietihg job applications. 

• Employer/job information. 

• Job seeking. 

• Interviewing skills. 

• Task eompietioh. 

• Time management. 

• Dependability/reliability. 

• Advancement. 

• Cooperation. 

• Responding to supervision. 



Dutchess/Putnam 
Consortium 



Completing job applications. 

Interviewing skiiis. 

Resumes. 

Dependability. 

Work attitude. 

Responding to supervision. 

Qperatihg job-related equipment/machines. 

Working relationships. 

Personal appearance. 



Los Angeles City 



Assessment of personal capabilities and interests. 

Career plaiining. 

Money management. 

Job search skills. 

Resumes. 

Personal appearance. 
Completing job applications. 
Interviewing skills. 
Work attitude. 
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ApiMehdixV 

FreEmilpYinei^ Maturity____ 
Competencies Inciudedin the Youth . 
Competency Systems of Ei^t SDAs (Pirogram 
rear 1984) 



Dependability. 

Operating job-related equiprheht/machihery . 
Working relationships. 
Responding to supervisidn. 



Shreveport City 



Assessment of aptitudes and interests. 
Appropriate work behavior. 



Tri-County Cohsortir: 



Completing job applications. 
::5ijrviewiny skills. 
Resumes. 

cbmmuiiicatibri. 
Job sources. 
Information sources. 
Personal appearance. 
Job interview fdlldw-up skills. 
Obtaihihg written references. 
Personal interests. 
Personal skills. 
Lcibdr market inft)rmatidn. 
Decisidn-makihg skills. 
Identifying sources of career information. 
Develop a career. 
Attendance. 
Tardiness. 

Maintains an average rating in significant job elements. 
Employer expectation. 
Basic math skills. 
Safety rules. 
Work attitude. 

Receiving constructive criticism. 
Work readiness. 
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Basiq Education Ctompetencies Included in the 
Youtii Competency Systems of Eight SDAs 
(Program Year 1984) 





FoHqvmig acre the basic education competencies included in the youth 
competency training systems of the eight SDAs visited by GAo. 


South Florida 
Consortium 


• Remedisfl education in reading, such as sight vocabulary, consonants, 
vowels, and suffixes. 

• Remedial education in Elnglish, such as ridUns, verbs, sentence structure, 
and spelling. 

• Remedial education in mathematics, such as addition, subtracting of 
whole numbers, percentages, plane geometry, and multiplication. 

• Remedied education in social studies, such as American history, political 
science^ geography, and economics. 

• Remedial education in science^ such as biology, earth science, chemistry, 
and physics. 

Note: In practice, a participant's scores on the Test of Adult Baisic Edu- 
cation \vej e used to determine competency deficiencies and later to 
assess attainment of the above types of competencies. 


Pacific Mountain 
Consortium 


Gr' r>f-Sehool Youth 


• Obtain a General Education Development certificate. 

• Obtain a high school diploma. 

• Complete one quarter of adult basic education. 


In-School Youth 


• Complete the grade in which the youth was enrolled at the start of jtpa 
training. 


Dutchess/Putnam 
Consortium 


• Remedial education in basic eoinmunieatioh sldlls, such as cadihg and 
\ ' Itihg and job-related mathematics. 

• Remedial education in computation 


Los Angeles City 


• Remedial education in basic academic abilities, such as \ ocabulaiy and 
reading. 

• Written communication. 
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Baaic Education Competendes Included in- 
die YoufhX>>nipetency Systems of EUghC SDAs 
(Program Year 198^ 



• Remedial education in computation skilis, including addition and 
subtraction. 



Boulder Gounty , Tfi- 
Coxinly Consortium^ 
Pittsburgh City, and 
Shreveport City 
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Appendix VII 

Job-Specific Competencies Included in the 
Youth Competency Systems of Eight SDAs 
(Program Year 1984) 



Following are the job-speeifie eompetencies included in the youth com- 
petency traihmg systems of the eight sdas visited by gag. 



South Florida 
Consortium 



Lists of specific competencies had been approved for 17 occupations. 
Occupations most often taught were clerical, auto mechanics, security 
guard, and nurses aid. As an example, 64 competencies had been 
approved for the clerical occupation cluster. Some of the types of cler- 
ical competencies were: 



• Greeting visitx)rs. 

• Answering the telephone. 

• Placing phone calls. 

• Typing speed. 

• Typing business lettere. 

• Typing addresses and envelopes. 

• Spelling. 

• Taking and transcribing dictation. 

• Cbriipleting monthly statements for customers. 

• Word processing. 



Pacific Mountain 
Consortium 



Although the private ihdustiy cbuhcil apprbved the ihelusibh of jbb- 
speeifie skill ebmpeteheies in the sda's competency system, the council 
had not approved a list of specific competencies for any occupations. 
Instead, the contractor/program operator entered into an agreement 
with local employers whoprojvided worksite job training. The agreement 
delineated the ebmpeteheies. For example, an agreement for training a 
youth in custodial trairahg listed the following competencies: 



Vacuuming. 
Floor maintenance. 
Window washing. 
Stripping smd waxing floor. 



Shr6V6D0rt GitV Job-specif ic skills competencies for the Shrevepbrt snA were not 

^ oceupation-speeifie. The private industry council approved one general 

job-specific skills competency that required p^icipants to "demon- 
strate skills required for entry level employment in a chosen field of 
interest." 
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Job-SP«ciflc Cbmpetendes iddadedintbe 
Yonth Competency Systems of Eight SDAb 
(Program Year 1984) 



Beulder Geimty, Tri- 
Gbimty Consortium, 
Pittsburgh City, 
Dutchess/Putnam 
Consortium, and Los 
Angeles City 
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Appendix Vlil ^ 

Gdffipafison of i^Mnployment/Work 
Matimi^ Cknti^tency Statements Provided by 
SaneSDAs 



To illustrate some of the diversity in sdas' cbmpetehcy statements, we 
compare in this appendix statements on three pre-employment /work 
matunty competencies (career planning, job search, and i' iterviewing) 
from some of the eight sdas we visited. The statements are direct quota- 
tions from the competency training plan approved by each sda's private 
industry council. 



Career Planning 
Competency 



Boulder County SBA The participant will complete a sample career plrni. 



Padf ie Mountain The participant will (1) determihe how to choose a career that fits his/ 

Consortium SDA hef interests and vSues, (2) identify steps and procedures to reach 

career goals, (3) re-think career goals aiid plans to change them when 
necessary^ (4) recognize that career planning is on-gbing rather than a 
single life event, and (5) obtain a satisfactory performance rating at the 
end of the training period. 



Pittsburgh City SDA The participant will make realistic career plans by (1) selecting one or 

two careers consistent with inter % abiiities, resources, and con- 
straints, (2) listing r and identifying three local employers 
currently hiring for those jobs, (3) completing a detailed 5-year career 
plan and steps for achieving the plan, and (4) identifying realistic initial 
salary expectations. 



Job Search 
Gbrripetehcy 



South Florida Consortium The participant will increase skills in using want ads and other sources 
SDA identifying job openings and will have an increased understanding of 

the hiring process and increased skill in following up on job leads. 
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C^^mpai^n of 

Maturity Coinpetency Statementc Froviited 
by Some SUAs 



Pittsburgh Gity SDA 



The participant will IcmdIc for a job by (1) developing a network of refer- 
er^ces, pemormel managers, friends, relatives who have information on 
, ; >3, (2) developing a list of job resources, (3) making three personal 
visits to employers to gather information, and (4) following up personal 
visits with letters and phone calls. 



Pacific Mountain 
Gonsortium SDA 



The participant will (1) make reaJistic choices of jobs to apply for, (2) 
create a plan to conduct a job search, (3) prepare a resume surnrnarizing 
experience, education and ^bb traihihg, (4) identify specific employers to 
approach by using cbmmuitfty resources, (5) practice contacting 
employers, completing job applications, setting up interviews, (6) under- 
stand hiring practices of relevant employers, and (7) obtain a satisfac- 
tory performance rating at the end of the training period. 



biterviewing 
(Competency 



Tri-Coun y Gonsortium SDA The participant will acquire appropriate interview techniques. 



Los Angeles Gity SDA 



The participant will be able to perform well in oh interview by (1) 
appearing appropriately groomed and dressed, (2) answering questions 
directly and completely, (3) speaking clearly and distinctly, (4) clearly 
stating personal capabilities, (5) asking appropriate questions pertinent 
to specific job skills, salary, and benefits, and (6) showing up on time oi- 
ls minutes eariy. 



South Florida Consortium 
SDA 



Objective: To develop the competencies heeded for success in job inter- 
views. Desired results: The participant will increase competencies 
needed for successful job interviews. 
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How Mght SlMs Assessed New EraTollie^ 
QDitipetency Deficiencies (Riopmi Year 1984;) 







Methods of assessing cc 


)mpetencv deficiencies of hew enfollees, by cornpetencv area 




Pre-employment/work maturity 


Basic education 


Uob-specific sRiiis 


South Florida 
Consortium 


No formal assessment. Participants 
assumed deficient in pre-employment 
competencies. 


Participants were not specifically 
assessed for competencies approved 
by^ the private indostry council. Test of 
Adxjit Basic Education used to 
determine overall basic education 
competency before start of training. 


No fprmal assessmenj, Rarticipanjs _ _ 
were assumed deficient in job-specific 
skills competencies. 


Boulder County 


Np formal assessment Participants 
assumed _to_ be deflcienl in pre- 
employment competencies. 


N/A 


N/A 



Pacific Mountain No f ormal assessment. Informal 
Consortium assessment consisted of cc^^^^^ 

between^outh and ^ counselOL to 
develop an individualized training 
plan. Private industry councH opposed 
stanclardized testing for assessment 
of deficiencies. 



Inforrrial, including conversations with 
participants and observation of 
participant behavior: 



InformaL includfng c with 
p3rticipaDts_and observation of 
participant behavior: 



Tri-County DifferenLfox various participants: In- 

Consortium school youths from local schools 

assessed by school records, teacher 
evaluations, and observation. Out-df- 
sch Dol xcyjih _at tejided.l- week 
assessment at a local coUege. Formal 
tests used included the Test of Adult 
Basic EducatibhLthe Holland 
!nyentpjy,_Wid_e_Range loteres*. 
Opinion Test, and the General 
--— — Aptitude Test Battery. 



N/A 



N/A 



Pittsburgh City Standardized tests, developed in 
PPhjuhcUpn withia IpcaLuniverslty, 
in^rporated 1 2_of 21 j^ijproved 
competencies into written and 
behavioral assessmehj^ iristrumerits. 
The SUA planned Jo develop during 
prcsfanvyear 1985 an instrument 
ting_alL21x 



N/A 



N/A 



Dutchess/ Putnam 
Consortium 



Standardized tests, including 
Participant Assessment of Youth 
EJigibility Skills and Ge^nera^ 
Test_Battery. Also^(l) observation of 
behavior in inten/iews, (2) evaluation 
of work history and discussions with 
teachers and counselors^ and (3) 
locally designed sejf-evaluation tests^ 



Test of Adult Basic Education and 
locally designed tests. 



N/A 



Los Angeles City 



Observation of behavior in inten/iews, 
evaluations from teachers or 
counselors, and ability to identify job 
interests. 



Obsen/atlon of behavior, review of 
behavior, review of school records, 
evaluations from teachers and _ 
counaebrs, and Stanford Test of 
^ademic Skills. 



N/A 
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How Eight SDAs Asseased New Enrolle<^* 
Competency Deficiencies (Program Year 
19S4} 



Methods of asa 



Pre-empl oyment/workJnatarity Basic education 



y^eftclef icl e s of n e w eflroHees^ by CQmj)etency area 



Job-specific sRiiis 



Shreveport City Obsejvatldn of behavior in Interviews, 
counselors* evaluations, . and review of 
wo^ri hj St ojy^nil school records. 
Standardized tests, e:g:. Adult 
Performance Level Test of 
Occupatibhal Knowledge. 



N/A 



Obse'vatjon of participant .behavior. 
during_[nlerviews, self-assessment by 
the participant, and results of locally 
designed assessment tests. 



Appendix X 

How Eight SDAs Assessed Enrollees' 
Attainment of Competencies (Pragram 
Year 1984) 



SDA 



Prereinc 



Methods of assessing attainitient of GotitE 



Basic education skills 



Uob-speoific skiils 



Soath Florida Youths (trained by contractors) 
Consortium required to pass tests adrrlinistered 

by an SDA staff trainiri§ design 

speciaJlst. Attainment measured by 
the ability to complete a job 
application, effectively part|cjpate in a 
job interview, and achieve a score of 
75 percent on a standard rating form. 



Test of Adult Basic Educatidh Used. 
Pbsttest scores compared with 
pretesi sco re s tojdeterjn in e_wheiher 
participant skills had risen to level 
agreed upon by SDA training design 
specialist and training contractor jDribr 
to start of training. 



SDA training design specialist 
adm!nister:ed writt_eln_an_d _hands-on 
tests to measure competency 
attainment for each occupation. 
PartJ^cipahts failing tests were 
schedujed for retesting after receiving 
more training by contractor. 



Boulder Goanty Trainers (including SDA staff and 

contractors) ratea each participants 
perfdrmahce as "satisfactory** or 

"unsatisfactory.** 



N/A 



N/A 



Pacific Mountain Measurementbt pre-employment 
Consortium competency based on training 

coruractors* judgment of partjcip 
perfdrmahce. Participants rated 
^'acceptable** or_"no±accepiab^ 
Work maturity attainment measured 
by meeting employer*s defined 
expectations as documented on 
evaiuatibh sheet. 



Participants required to (1) complete 
grade enrolled in at time of 
Gdmpetency training, (2) obtain a 
Genera! Education Pevelopment _ 
certificate, (3) obtain a high schooJ 
diploma,-or (4) -complete one quarter 
of Adult Basic Educatidh. 



Tri-Caunty_ 
Consortium 



Attainments monitored by SDA staff. 
Participants trained by local schools 
monitored bi-weekly; youths trained 
by SDA staff monitored daily. SDA 
staff j'eviewed.aciiyities.cojTipietexl by 
participants, observed participant 
behavior, and discussed participant 
progress. Ldcally designed pdsttest 
administered by SDA staff at end of 
training. _ _ u i ^ 



N/A 



EmpJoyers who provided on-the-jdb 
training rated each pa'*icipaht's 
ability to perform job tasks.' 'with __ 
assistance" or "without assistance.' 



N/A 



Pittsburgh City 



Competency system incorporated 39 
of 70 competency benchmarks 
appiroyed by the private industry 
coyncil.iELeyen were.asaesseil using, 
a standardized written test developed 
in conjunction with a local university; 
28ibehavidral) by the trainer from 
pbseived behavior. Participants had 
to attain. 27 benchirjarks to be 
considered- successful: 



N/A 



N/A 



Dutchess/ Putnam 
Consortium 



Used Participants Assessment of 
Youth Eligibility Skills Test and locally 
designecT hands-on iests. Also, _ _ 
participants had to complete tasks, 
e.g., a job application, resume, and 
cover letter. 



Determiried by scores on Test of 
Adujt Basic EducajLon or by attaining 
a General Education Development 
certificate or high school diploma. 



N/A 
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How Ejiht ^DAs Aflee^ _ 
Attainment of Coi&petenciefl (Progran) 
Year 



Methckia of assesaing attainment ol competencies by competency area 

SPA Pre-emp l byment/work maturity Basic education skills Job-specific skills 

Los Angeles City Used AduLt PeMrman^^^ Test of Participaots had id demonstrate an N/A 

Occopatlonal Skllls for pre- iacreased-Ievel of performance on the 

employment competenoy attainment; Stanford Test of AGademlc Skills. 

emjDiqyeir appraisals and other Also, used evaluations from teachers, 

eyalLf atjons of partjclp^ cpunselorsa and_superyisors_ and 

performance f or_work maturity results from mastery tests to measure 
competency atta i nmen t competency attainment. 

Shreveport City For pr^-employment skills, N/A Used employer's observation and 

participants had to identify three performance of hands-on tests, 

career choices that matched their _ 
skills and abilities; work maturity skills 
were measured by employer's 
obcervatibn of behavior and 
peitorrnance d uringL train ing . 
Participanis had to be rated 

— "satisfactory" by worksite supervisor. 
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Title n-A 
Visited by GAO 




of Youths Enrolled in 
Traiiiiiig in iSght SDAs 
(Progfam Year 1984) 




SPA _ 
Sooth Florida Consortium 

Boulder County 

Pacific Mountain Consortium 

Trt-Coanty C on sPrtip m 

Pittsburgh City 

DUtchess/Putriam 
Consortium 

Los Angeles City 

Shreveport City 



Out-df- 
schbbl 



Cbmpetehcy 

training 

-participants Priority gro ups Ih-schbbI 

1,930 DrdpoUts, welfare re^^^ No Yes 
handicapped, blacks, othe r minorities 

72 None _ _ ~ Yes Yes 

1^ None - Yes 

289 None Yes 

10 None Yrs 

89 None Yes Yes 

26 J Nor. ~ Yes 

181 Dropouts, weiiare recipients. Yes Yes 
handicapped, blackjf^ Hi^ 
American Indiaa^^^iiher minorities 



Age 
14-15 



No 



Yes 



No 



Yes 



_No_ 



No 



Yes 



No 



Aoe 
16-21 



Yes 



Yes 



Yes 



Yes 



_YlBS_ 



Yes 



Yes 



Yes 
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Comments From the Department of Labor 




U.S. Department of Labor 



AsSiSLaril Sfjctelary for 
Emp[oy_men| c. nd Train"' g 
Wa^^hing'or. D C 20^10 




Nov 2 



0 IS&S 



Mr. Richard L- Fbgel 
Assistant_Comptrpiier General 
Huroan.Resources Division. 
D.S^ General Accouneing office 
Washington, 'D.C. 20548 



ar Mr. Fogel: 

reply to your letter to the Secretary of Labor requesting 
.r-.r>nts on the draf t _GAO_ report en ti tied _ "Jo_b_ Training, Partner- 
ship ,>ct_: _ Problems Measuring Youths' Attainment of Employment 
Competencif>s , " the Department s respor^se is enclosed. 

The Depart:,-t£ It appreciates th- ^opportunity to comment on this 
report. 




SEMERAD 
scant SecroLary of Laoor 



Enclosure 
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Conunents From the Department of . \lx>r 



U.S. DeparemenC of Labor's Response To 
The Lyraft General Accounting Office Report 
En titled- 
Job Training Partnership Act: 
Problems Measuring Youths' Attainment 
of Employmeiit Competencies 



Re c omme hd a t ion ; The Secretary of Labor should (1) recgmmend that 
States adjust the_performancestanda take into accounc the 

differences in competency systems, and (2) provide technical 
assistance to help states make these adjustments. 

R e sp o ns e ; The Departaent concurs. 

Comments £ The Department believes that this report is extremely 
thorough in describing the extent and nature of youth competency 
system*, as of June 30, 1985, apd perceptive in.analyzingand, ____ 
portray jLng_ the _ complex ity_of issues involved in incorporating into 
the national performance standards process, the. attainrtieht of youth 
employment competencies recognized by the local priva;;e industry 



The Dep^.rtment plans to continue to provide policy guidance 3nd 
technical assistance to States thrbiigh the ann^^al perfbrmaru ^ 
standards technical assistance gui^e and_ tr^.? ning con£ 
Because_pf__the_new_JTPA_Annual_ Status Report definition for 
reporting youth competency : attainment in Program Xear 1986^ the 
Department expects that adjustments tb performance standards beyond 
thie model to account for different degrees cf sophistication in _ 
local competency prpgrams_will begiyen additional emphases in both 
the technical assistance guide and training conferences. 



counc il « 
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Gomments From the Office of Management 
and Budget 





EXECyTlVE OFFICE OF THE PRESIP . iT 
OFFICE OF MANAi3£MENT_AND BUDGt . 
WASHINGTON, D.C. 20503 



^OV 2 11986 



Mr. William Anderson 

Assistant Cpmptrol ler General 
General Accounting Office 
Washington, D.C. 20548 

bear Mr. Anderson: 

Thank you for providing the Office of Management and Budget 
(0MB) with the opportunity to comment bh the General _Accounting 
Of f ice' s_iGA01siidra ft report entitled, "Job Training Partnership 
Act: Problems Measuring Youths' Attainment of Employment 
Competencies." OMB strongly supports the Job Training 
ParthersLip Acf^s (JTPA's) emphasis oh youth training and the 
Department of Labpr';s iPQL^si efforts. to_ encourage States and 
lpcaiities_ to provide competency-based training to youth 
participating in the JTPA program. 

'^^.^o^l^ li^f* J^o con'^.ne pur_cpmiTients tp the presentation of 
jMB's disapprpval_of +-.he proposed additional data elements for 
the JTPA Annual Statv.s Report (JASR) concerning youth competency 
attainment. We believe that the report faiils to L.udress 
adequately the issues considered during OMB's review of the 
DOL proposal. 



On January 10, 1986, the Department submitted to OMB for 

P^Pf ^^'^^cition Act^ r^ seyeral_prpppsed changes : tp _ the 

JASR. Two of theprpposed changes pertrined to youth competency 

attainment. Specifically, one proposed addition (I.B.2.a. on the 
form) would have asked for the total number of youth who have 

attained youth "ompetencies recpgnized bythe pr 

councils (PICsi the prganizations that set overall policy at" the 
local, or service delivery area (SDA) ^ level . The other proposed 
addition (Section IV of the form) would have required SDAs to 
^^2°?^ VP^^^ 2i"ttai nments or def iciencies in three skill areas: 
pre-employment/work maturity skills, basic educacion skills, and 
job-specific skil"?-^.. 

^D -^P^il^^P? 1986, after several meetings with bOL_staff and a 
carefuireyiewpf comments on the proposal^ oMB approved the 
proposed additional data collection on yoath attaining 
PIC-recognized youth competencies (I.B.2.a.) and disapproved the 
detailed data collection on cpmpetency_ attainment pn three_skill 
areas_lSection IV) . The Department appealed the oMB disapproval 
on April 23, _i"^86. After thorough consideration of the appeal, 
including additional meetings with DOL, the DOL appeal was denied 
oh June 18, 1986. As we noted in the June 18th letter notifying 
the Department of our decision, "the Paperwork Reduction Act 
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mandates that both the collecting agency and 0MB ensure that any 
proposed coilection of information is absolutely necessary for 
the proper performance of the agency's function, is net 
^^P- "^^si^i^e of existing cpilectionsj, ard_ imposes, minimum burden _ 
on the public. _ln_pur_ judgment, the prcposed data elements. • .do 
not meet these criteria." 

0MB had two major concerns with the proposed Section. IV of the 
JASR. __First,_ the_proposed^ d collection wcuid appear to 
threaten the prerogative of the PICs and States^ to define what 
constitutes a youth competency and a youth c^ .Lcetehcy system. 
Second, the data collected under Section TV wGald_be used to 
develop a very detailed performance measure that could not be 
applied fairly across SDfts nationwide. 

As indicated by the title of t' Act> the JTPA program_is_a 
"Parthership«« between, Federal, State, and local governments and 
between these governments and the private. sector as represented 
by the ^ PICS. Each partner has responsibilities and authorities 
est .LXished by the Act and by administrative practices developed 
over the past three years. 

The JTPA requires the Secretary :? .^v.r tb establish national 
performance standards f or the D^r : pf Labor and the states 

to Use in evaluating prograin_suc:i^ ^'ection_106(b) (2) requires 

the Secretary to_estabiish_ performcr.Ce standards, for youth 
programs on the basis. of, among other factors, the attainment 
of PIC-recognized employment competencies. The Act does not 

^^?^°^f2e the Secretary to define those. cpmpetencies_pr to 

prescribe what should be included in a competency-based system. 

Because of . our Federalism and riBgula'*:bry relief cbhcerhs, OMB has 
consisl,ently asked DOL and the other three departments with block 
9?"^"^ Pi^ograms ehact^^ 1981_ (Education, Health and Human 
Services i and Housing and Urban Development) to limit. regulatory 
and paperwork. requirements- so as to provide maximum flexibility 
to State and local officials. As GAO has npted in its report 
entitled, "Block Grants Overview, pfExper Date and 

Emerging Issues," HRb-85-46, Federalism has worked, effectively 
because of the proven competence of State and local program 
administrators . 

Many grpupsy including States and PICs, commented_on the proposed 
JASR which DOL published in the January 14, 1986 Federal 
Register ^ Of the cbmmehts received ph the proposal, we fpund 
^^^^ V^^^f >!*e3irly. £^ii who^cpmmented 

additipn agreed. in principle with the. concept, most objected to 
the inclusion of Section IV on the following grounds: (1) the 
data.in.I.B.2.a. were sufficient tb establish a performance 
standard, (2) the data in Sectipn IV would_encr5)ach_on _PIC_ 
authprity tp define what constitutes a youth competency and to 
determine what should be included in a youth competency-based 
training system, and (3) the data in Section IV would hot be 
useful LOL sinc(» the youth competency standards vary widely 
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across SDAs. Cbmments from the State cf Wiscbhsih, in effect, 
summarize the concerns of those who pb the proposed 

section. Wisconsin asserted that "the Act explicitly leaves the 
deciision whether to develop a Cydul:h competency] system and the 
nature and extent of a system to local prerogative. The 
inclusion of Sect ipn_ XV o serve_to coerce SDAs 

toward the development of youth, competency systems designed to_ 
attain high ratios of attainments to deficiencies even though the 
meanings of the terms * deficient' and ^attained' may vary widely 
in the absence of standardi^ That pol i '^y 

direction is counter to the intent of the Act." 

As a side note, DOL did hoc rhise for debate or discussion the 

youth competency data element the forum it had to assess 

established: performance standards issues. : The JTPA Pr.rformance 
Standards Advisory_Council --_made up of all parts. of _ the JTPA 
system, including States and PICs — considered all the other 
proposed chahig[es to the JASR, including the post-pirogra/n followup 

data collection^ but not the_proposed yputh_ competency t-ata 

elements L in_ Section IV. These data elements were added to the 
JASH after the Council had made its final recommendation 
regarding the other proposed changes. One of the principal 

parties on the Advisory Council/ _the National Gpyernprs ' 

Asspciatipni expressed concern about this lack of consultation 
in its comments on the proposal. Given the_ critical roles that 
''*'*tes and PICs play in administering the JTPA program, these 
jnents should riot be dismissed lightly^ in fact, DOL 
_l^owiedged_ail pf _ttie above, concerns inithe June 18,^ 1986 
Federal Register notice that announced the final decisions 
regarding the JASR. Thus, we believe that these concerns me:^ited 
far more cbnsideratibri thari they were giveri iri the draft GP.O 
report. 

In addition to the important Federalism issues the DOL proposal 
raised, OMB was coricerned about the subjective nature of i"he 
attributes of youth_cpmpetency_ attainment th DOL was at-emr -ing 
tomeasUre. Weshared Wisconsin's skepticism about the 
usefulness to DOL of data pertaining to the atior of youth 
competency attainments to deficiencies when che meanings of the 
terms ^def icierit' and ^attained ' will an^^ 

local needs and priorities, probably should vary across States 
and SDAs. 

Since th( skill levels and training_needs of yc uth_yary 

considerably among sdAq the PICs are in a much better position 
then DOL to determine wnat the needs of local youth are and when 
those needs have been met. The issue of consistency cf youth 
competency measures acrpss SDAs is properly a question to be 
resolved by the individual States and their SDAs. We believe the 
GAO report effectively. highlights the difficulty of determining 
lO'T^il heeds. By establishing a specific, standardized reporting 
system for youth cpmpetency attainments^ however, DOL would be 
taking away State and pic flex^' lity to cievelop youth cpmpetency 
systems to meet those local ne it is chis concern for 
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preserving the JTPA-es^ to structure local 

trair. ■Lng systems to meet local needs that underlies our decision 
^^o .disapprove the prop* sed data elements at Section IV to- the 
JASR pertaining to youth competency attainment. In pur opinion, 
rpweyer, the gao report does not fully address this important 
concern. 



We ':2lsb object to the proposed report's inferences on_paget^ 11 
^J}^^ 54 that in meetings held_betw^ QMB in Octobei: 1983, 

QMB indicated that it would not apprc:7e any ::,abor request co 
collect data on youth competencies. We havt-: no record that 0MB 
ever made such statements to DOL. Furtheraore, oMB would_npt 
^^^•^ , Action on any proposed data_collectipn_bef ore it is formally 
^ut'initted_tp QMB for paperwork Reduction Act review.' Thus^, we 
rerniast that GAO provide this necessary clarif icatibh in the 
report . 

Agairij, thank_ypu fpr_ providing us with the opportuni ty to comntent 
on the proposed report. Tf you have any questions regarding pur 
cpmments^ please do not liesitate ^ - ^.-3t me. 




jp'nes B. -MacRae, Jr. 
Deputy Adminiistratbr 



Office of information and 



Regulatory Affairs 



(205056) 



Page 89 




GAO/HRD-87-33 Tbuth Competehcies 



ERIC 



